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PREFACE 


No observation is ever exact. As a corollary, every observation contains error. 
These statements are fundamental and accepted universally. It follows logi¬ 
cally, therefore, that surveyors, who are measurement specialists, should have 
a thorough understanding of errors. They must be familiar with the different 
types of errors, their sources, and their expected magnitudes. Armed with this 
knowledge, they will be able to (1) adopt procedures for reducing error sizes 
when making their measurements and (2) account rigorously for the presence 
of errors as they analyze and adjust their data. This book is devoted to creating 
a better understanding of these topics. 

In recent years, the least squares method of adjusting spatial data has been 
rapidly gaining popularity as the method used for analyzing and adjusting sur¬ 
veying data. This should not be surprising, because the method is the most 
rigorous adjustment procedure available. It is soundly based on the mathemat¬ 
ical theory of probability; it allows for appropriate weighting of all observations 
in accordance with their expected precisions; and it enables complete statistical 
analyses to be made following adjustments so that the expected precisions of 
adjusted quantities can be determined. Procedures for employing the method 
of least squares and then statistically analyzing the results are major topics 
covered in this book. 

In years past, least squares was only seldom used for adjusting surveying 
data because the time required to set up and solve the necessary equations was 
too great for hand methods. Now computers have eliminated this disadvantage. 
Besides advances in computer technology, some other recent developments 
have also led to increased use of least squares. Prominent among these are 
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the global navigation satellite systems (GNSSs) such as GPS and geographic 
information systems (GISs). These systems rely heavily on rigorous adjustment 
of data and statistical analysis of the results. But perhaps the most compelling 
of all reasons for the recent increased interest in least squares adjustment is 
that new accuracy standards for surveys are being developed that are based 
on quantities obtained from least squares adjustments. Thus, surveyors of the 
future will not be able to test their observations for compliance with these stan¬ 
dards unless they adjust their data using least squares. This edition discusses 
these newer methods of classifying maps and control no matter the source. 
Clearly modern surveyors must be able to apply the method of least squares to 
adjust their observed data, and they must also be able to perform a statistical 
evaluation of the results after making the adjustments. 

In the sixth edition, the author has included instructional videos to 
accompany Chapters 1 through 25 and Appendixes A through C in the book. 
These videos provide instructional lessons on the subject matter covered in 
the book. They also demonstrate the solution of example problems using 
spreadsheets and the software that accompanies the book. Additionally, this 
book discusses proper procedures to compute accuracy estimates following 
both the Federal Geographic Data Committee and ASPRS Digital Geospatial 
Data and control surveys. For instructors who adopt this text in their classes, 
an Instructor’s Manual to Accompany Adjustment Computations is available 
from the publisher’s website. This manual includes detailed solutions to all the 
problems in the book along with suggested course outlines and exams, which 
can be used in their courses. It is available to all instructors who adopt this 
book. To obtain access the manual contact your regional Wiley representative. 

The software STATS, ADJUST, and MATRIX will run on any PC- 
compatible computer in the Windows environment. The first package, called 
STATS, performs basic statistical analyses. For any given set of observed data, 
it will compute the mean, median, mode, and standard deviation, and develop 
and plot the histogram and normal distribution curve. It will also compute 
critical values for the t, / 2 , and F distributions. New features include its ability 
to compute critical values for the r distribution, confidence intervals for the 
population mean variance, and ratio of two variances, and perform statistical 
test for the population mean, variance, and ratio of two variances. 

The second package, called ADJUST, contains programs for performing 
specific least squares adjustments covered in the book. When performing least 
squares adjustments, ADJUST allows the user to select either data snooping 
or the tau criterion for post-adjustment blunder detection. The program 
contains a variety of coordinate transformations and allows user to fit points 
to a line, parabola, or circle. A new feature in MATRIX is its ability to perform 
unweighted and weighted least squares adjustments with a single command. 
Using this program, systems of simultaneous linear equations can be solved 
quickly and conveniently, and the basic algorithm for doing least squares 
adjustments can be solved in a stepwise fashion. For those who wish to develop 
their own software, the book provides several helpful computer algorithms 
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in the languages of BASIC, C, FORTRAN, and PASCAL. Additionally, 
the Mathcad worksheets on the companion website demonstrate the use of 
functions in developing modular programs. 

The chapters of this book are arranged in the order found most conve¬ 
nient in teaching college courses on adjustment computations. The content in 
this book can be covered in two or three typical undergraduate, college-level 
courses. It is believed that this order also best facilitates practicing surveyors 
who use the book for self-study. In earlier chapters we define terms and intro¬ 
duce students to the fundamentals of errors and methods for analyzing them. 
The next several chapters are devoted to the subject of error propagation in 
the various types of traditional surveying measurements. Then chapters follow 
that describe observation weighting and introduce the least-squares method for 
adjusting observations. Applications of least squares in adjusting basic types 
of surveys are then presented in separate chapters. Adjustment of level nets, tri- 
lateration, triangulation, traverses and horizontal networks, GNSS networks, 
and conventional three-dimensional surveys are included. The subject of error 
ellipses and error ellipsoids are covered in a separate chapter. Procedures for 
applying least squares in curve fitting and in computing coordinate transfor¬ 
mations are also presented. The more advanced topics of blunder detection, 
the method of general least squares adjustments, and computer optimization 
are covered in the last chapters. 

As with previous editions, matrix methods, which are so well adapted to 
adjustment computations, continue to be used in this edition. For those stu¬ 
dents who have never studied matrices, or those who wish to review this topic, 
an introduction to matrix methods is given in Appendixes A and B. Those 
students who have already studied matrices can conveniently skip this subject. 

Least squares adjustments often require the formation and solution of non¬ 
linear equations. Procedures for linearizing nonlinear equations by Taylor’s 
theorem are therefore important in adjustment computations, and this topic is 
presented in Appendix C. Appendix D contains several statistical tables includ¬ 
ing the standard normal error distribution, the x 2 distribution, t distribution, 
and a set of F-distribution tables. These tables are described at appropriate 
locations in the text, and their use is demonstrated with example problems. 

Basic courses in surveying, statistics, and calculus are necessary pre¬ 
requisites to understanding some of the theoretical coverage and equation 
derivations given herein. Nevertheless, those who do not have these courses 
as background but who wish to learn how to apply least squares in adjusting 
surveying observations can follow the discussions on data analysis. 

Besides being appropriate for use as a textbook in college classes, this book 
will be of value to practicing surveyors and geospatial information managers. 
With the inclusion of video lessons, it is possible for practitioners to learn 
the subject matter at their leisure. The author hopes that through the publica¬ 
tion of this book, least squares adjustment and rigorous statistical analyses of 
surveying data will become more commonplace, as it should. 
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ADJUSTMENT COMPUTATIONS 


CHAPTER 1 


INTRODUCTION 


1.1 INTRODUCTION 

SS We currently live in what is often termed the information age. Aided 
by new and emerging technologies, data are being collected at unprecedented 
rates in all walks of life. For example, in the held of surveying, total station 
instruments, global navigation satellite systems (GNSSs) equipment, digital 
metric cameras, laser-scanning systems, LiDAR, mobile mapping systems, 
and satellite imaging systems are only some of the new instruments that are 
now available for rapid generation of vast quantities of observational data. 

Geographic information systems (GISs) have evolved concurrently with the 
development of these new data acquisition instruments. GISs are now used 
extensively for management, planning, and design. They are being applied 
worldwide at all levels of government, in business and industry, by public 
utilities, and in private engineering and surveying offices. Implementation of 
a GIS depends on large quantities of data from a variety of sources, many of 
them consisting of observations made with the new instruments such as those 
noted above and others collected by instruments no longer used in practice. 

However, before data can be utilized whether for surveying and mapping 
projects, for engineering design, or for use in a geographic information system, 
they must be processed. One of the most important aspects of this is to account 
for the fact that no measurements are exact. That is, they always contain errors. 

The steps involved in accounting for the existence of errors in observations 
consist of (1) performing statistical analyses of the observations to assess the 
magnitudes of their errors, and study their distributions to determine whether 
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2 INTRODUCTION 


they are within acceptable tolerances, and if the observations are acceptable, 
(2) adjusting them so they conform to exact geometric conditions or other 
required constraints. Procedures for performing these two steps in processing 
measured data are principal subjects of this text. 


1.2 DIRECT AND INDIRECT MEASUREMENTS 

Measurements are defined as observations made to determine unknown quan¬ 
tities. They may be classified as either direct or indirect. Direct measurements 
are made by applying an instrument directly to the unknown quantity and 
observing its value, usually by reading it directly from graduated scales on 
the device. Determining the distance between two points by making a direct 
measurement using a graduated tape, or measuring an angle by making a 
direct observation from the graduated circle of a total station instrument are 
examples of direct measurements. 

Indirect measurements are obtained when it is not possible or practical to 
make direct measurements. In such cases the quantity desired is determined 
from its mathematical relationship to direct measurements. For example, 
surveyors may observe angles and lengths of lines between points directly and 
use these observations to compute station coordinates. From these coordinate 
values, other distances and angles that were not observed directly may be 
derived indirectly by computation. During this procedure, the errors that 
were present in the original direct observations are propagated (distributed) 
by the computational process into the indirect values. Thus, the indirect 
measurements (computed station coordinates, distances, directions, and 
angles) contain errors that are functions of the original errors. This distri¬ 
bution of errors is known as error propagation. The analysis of how errors 
propagate is also a principal topic of this text. 


1.3 MEASUREMENT ERROR SOURCES 

It can be stated unconditionally that (1) no measurement is exact, (2) every 
measurement contains errors, (3) the true value of a measurement is never 
known, and thus (4) the exact size of the error present is always unknown. 
These facts can be illustrated by the following. If an angle is measured with 
a scale divided into degrees, its value can be read only to perhaps the nearest 
tenth of a degree. However if a better scale graduated in minutes were available 
and read under magnification, the same angle might be estimated to tenths of 
a minute. With a scale graduated in seconds, a reading to the nearest tenth 
of a second might be possible. From the foregoing, it should be clear that no 
matter how well the observation is taken, a better one may be possible. Obvi¬ 
ously in this example, observational accuracy depends on the division size of 
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the scale. But accuracy depends on many other factors, including the overall 
reliability and refinement of the equipment used, environmental conditions that 
exist when the observations are taken, and human limitations (e.g., the ability to 
estimate fractions of a scale division). As better equipment is developed, envi¬ 
ronmental conditions improve, and observer ability increases, observations will 
approach their true values more closely, but they can never be exact. 

By definition, an error is the difference between a measured value for any 
quantity and its true value, or 

£ = y-V ( 1 . 1 ) 

where e is the error in an observation, y the measured value, and /i its true value. 

As discussed above, errors stem from three sources, which are classified as 
instrumental, natural, and personal. These are described as follows: 

1. Instrumental errors. These errors are caused by imperfections in instru¬ 
ment construction or adjustment. For example, the divisions on a 
theodolite or total station instrument may not be spaced uniformly. 
These error sources are present whether the equipment is read manually 
or digitally. 

2. Natural errors. These errors are caused by changing conditions in the 
surrounding environment. These include variations in atmospheric pres¬ 
sure, temperature, wind, gravitational fields, and magnetic fields. 

3. Personal errors. These errors arise due to limitations in human senses, 
such as the ability to read a micrometer or to center a level bubble. The 
sizes of these errors are affected by personal ability to see and by man¬ 
ual dexterity. These factors may be influenced further by temperature, 
insects, and other physical conditions that cause humans to behave in a 
less precise manner than they would under ideal conditions. 


1.4 DEFINITIONS 

From the discussion thus far it can be stated with absolute certainty that all 
measured values contain errors, whether due to lack of refinement in readings, 
instabilities in environmental conditions, instrumental imperfections, or 
human limitations. Some of these errors result from physical conditions that 
cause them to occur in a systematic way, whereas others occur with apparent 
randomness. Accordingly, errors are classified as either systematic or random. 
But before defining systematic and random errors, it is helpful to define 
mistakes. These three terms are defined as follows: 

1. Mistakes. These are caused by confusion or by an observer’s careless¬ 
ness. They are not classified as errors and must be removed from any 
set of observations. Examples of mistakes include (a) forgetting to set 
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the proper parts-per-million (ppm) correction on an EDM instrument, 
or failure to read the correct air temperature, ( b ) mistakes in reading 
graduated scales, and (c) mistakes in recording (i.e., writing down 27.55 
for 25.75). Mistakes are also known as blunders or gross errors. 

2. Systematic errors. These errors follow some physical law, and thus, these 
errors can be predicted. Some systematic errors are removed by following 
correct observational procedures (e.g., balancing backsight and foresight 
distances in differential leveling to compensate for earth curvature 
and refraction). Others are removed by deriving corrections based on 
the physical conditions that were responsible for their creation (e.g., 
applying a computed correction for earth curvature and refraction on a 
trigonometric leveling observation). Additional examples of systematic 
errors are (a) temperature not being standard while taping, (b) an 
indexing error of the vertical circle of a total station instrument, and (c) 
use of a level rod that is not standard length. Corrections for systematic 
errors can be computed and applied to observations to eliminate their 
effects. 

3. Random errors. These are the errors that remain after all mistakes and 
systematic errors have been removed from the observed values. In gen¬ 
eral, they are the result of human and instrument imperfections. They are 
generally small and are as likely to be negative as positive. They usually 
do not follow any physical law and therefore must be dealt with according 
to the mathematical laws of probability. Examples of random errors are 
(a) imperfect centering over a point during distance measurement with 
an EDM instrument, (b) bubble not centered at the instant a level rod 
is read, and (c) small errors in reading graduated scales. It is impossi¬ 
ble to avoid random errors in measurements entirely. Although they are 
often called accidental errors, their occurrence should not be considered 
an accident. 

1.5 PRECISION VERSUS ACCURACY 

Due to errors, repeated measurement of the same quantity will often yield 
different values. A discrepancy is defined as the algebraic difference between 
two observations of the same quantity. When small discrepancies exist between 
repeated observations, it is generally believed that only small errors exist. Thus, 
the tendency is to give higher credibility to such data and to call the obser¬ 
vations precise. However, precise values are not necessarily accurate values. 
To help understand the difference between precision and accuracy, the follow¬ 
ing definitions are given: 

1. Precision: Precision is the degree of consistency between observations 
and is based on the sizes of the discrepancies in a data set. The degree 
of precision attainable is dependent on the stability of the environment 


1.5 PRECISION VERSUS ACCURACY 5 


during the time of measurement, the quality of the equipment used to 
make the observations, and the observer’s skill with the equipment and 
observational procedures. 

2. Accuracy: Accuracy is the measure of the absolute nearness of an 
observed quantity to its true value. Since the true value of a quantity can 
never be determined, accuracy is always an unknown. 

The difference between precision and accuracy can be demonstrated using 
distance observations. Assume that the distance between two points is paced, 
taped, and measured electronically and that each procedure is repeated five 
times. The resulting observations are: 


Observation 

Pacing ( p ) 

Taping (?) 

EDM (e) 

1 

571 

567.17 

567.133 

2 

563 

567.08 

567.124 

3 

566 

567.12 

567.129 

4 

588 

567.38 

567.165 

5 

557 

567.01 

567.114 


The arithmetic means for these sets of data are 569, 567.15, and 567.133, 
respectively. A line plot illustrating relative values of the electronically mea¬ 
sured distances denoted by e, and the taped distances, denoted by t, is shown in 
Figure 1.1. Notice that although the means of the EDM data and of the taped 
observations are relatively close, the EDM set has smaller discrepancies. This 
indicates that the EDM instrument produced a higher precision. Flowever, this 
higher precision does not necessarily prove that the mean of the electronically 
observed data is implicitly more accurate than the mean of the taped values. 
In fact, the opposite may be true if, for example, the reflector constant was 
entered incorrectly causing a large systematic error to be present in all the 
electronically observed distances. Because of the larger discrepancies, it is 
unlikely that the mean of the paced distances is as accurate as either of the 
other two values. But its mean could be more accurate if large systematic 
errors were present in both the taped and electronically measured distances. 
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FIGURE 1.1 Line plot of distance quantities. 
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Another illustration explaining differences between precision and accuracy 
involves target shooting, depicted in Figure 1.2. As shown, four situations can 
occur. If accuracy is considered as closeness of shots to the center of a tar¬ 
get at which a marksman shoots and precision as the closeness of the shots 
to each other then (1) the data may be both precise and accurate, as shown in 
Figure 1.2 (a); (2) the data may produce an accurate mean but not be precise, 
as shown in Figure 1 .2(b); (3) the data may be precise but not accurate, as shown 
in Figure 1.2(c); or (4) the data may be neither precise nor accurate as shown in 
Figure 1.2 (d). 

Figure 1 .2 (a) is the desired result when observing quantities. The other cases 
can be attributed to the following situations. The results shown in Figure 1.2 (b) 
occur when there is little refinement in the observational process. Someone 
skilled at pacing may achieve these results. Figure 1.2(c) generally occurs when 
systematic errors are present in the observational process. This can occur, for 
example, in taping if corrections are not made for tape length and tempera¬ 
ture, or with electronic distance measurements when using the wrong combined 
instrument-reflector constant. Figure 1.2 (d) shows results obtained when the 
observations are not corrected for systematic errors and are taken carelessly 
by the observer (or the observer is unskilled at the particular measurement 
procedure). 

In general, when making measurements, data such as those shown in 
Figure 1.2 (b) and 1.2(d) are undesirable. Rather, results similar to those shown 
in Figure 1.2(a) are preferred. However, in making measurements the results 
of Figure 1.2(c) can be just as acceptable if proper steps are taken to correct 



FIGURE 1.2 Examples of precision versus accuracy. 
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for the presence of the systematic errors. (This correction would be equivalent 
to the marksman realigning the sights after taking the shots.) To make these 
corrections, (1) the specific types of systematic errors that have occurred in the 
observations must be known, and (2) the procedures used in correcting them 
must be understood. 


1.6 REDUNDANT OBSERVATIONS IN SURVEYING 
AND THEIR ADJUSTMENT 

As noted earlier, errors exist in all observations. In surveying, the presence of 
errors is obvious in many situations where the observations must meet cer¬ 
tain conditions. In level loops that begin and close on the same bench mark, 
for example, the elevation difference for the loop must equal zero. However, 
in practice this is hardly ever the case due to the presence of random errors. 
(For this discussion it is assumed that all mistakes have been eliminated from 
the observations and appropriate corrections have been applied to remove all 
systematic errors.) Other conditions that disclose errors in surveying observa¬ 
tions are that (1) the three measured angles in a plane triangle must total 180°, 
(2) the sum of the angles measured around the horizon at any point must equal 
360°, and (3) the algebraic sum of the latitudes (and departures) must equal 
zero for closed traverses that begin and end on the same station. Many other 
conditions could be cited; however, in any of them, the observations rarely, if 
ever, meet the required conditions, due to the presence of random errors. 

The examples above not only demonstrate that errors are present in survey¬ 
ing observations but also illustrate the importance of redundant observations ; 
those measurements made that are in excess of the minimum number needed 
to determine the unknowns. Two measurements of the length of a line, for 
example, yield one redundant observation. The first observation would be 
sufficient to determine the unknown length, and the second is redundant. 
However, this second observation is very valuable. First, by examining the 
discrepancy between the two values, an assessment of the size of the error 
in the observations can be made. If a large discrepancy exists, a blunder or 
large error is likely to have occurred. In that case, observations of the line 
would be repeated until two values having an acceptably small discrepancy 
were obtained. Second, the redundant observation permits an adjustment to 
be made to obtain a final value for the unknown line length, and that final 
adjusted value will be more precise statistically than either of the individual 
observations. In this case, if the two observations were of equal precision, the 
adjusted value would be the simple mean. 

Each of the specific conditions cited in the first paragraph of this section 
involve one redundant observation. For example, there is one redundant obser¬ 
vation when the three angles of a plane triangle are observed. This is true 
because with two observed angles, say A and 5, the third could be computed 
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as C = 180° - A - B, and thus, observation of C is unnecessary. However 
measuring angle C enables an assessment of the errors in the angles to be made, 
and it also makes an adjustment possible to obtain final angles with statistically 
improved precision. Assuming the angles were of equal precision, the adjust¬ 
ment would enforce the 180° sum for the three angles by distributing the total 
discrepancy in equal parts to each angle. 

Although the examples cited here are indeed simple, they help to define 
redundant observations, and to illustrate their importance. In large surveying 
networks, the number of redundant observations can become extremely large, 
and the adjustment process is somewhat more involved than it was for the sim¬ 
ple examples given here. 

Prudent surveyors always make redundant observations in their work, for 
the two important reasons indicated above: (1) to enable assessing errors and 
making decisions regarding acceptance or rejection of the observations; and 
(2) to make possible an adjustment whereby final values with higher precisions 
are determined for the unknowns. 


1.7 ADVANTAGES OF LEAST SQUARES ADJUSTMENT 

As indicated previously, in surveying it is recommended that redundant 
observations always be made and that adjustments of the observations always 
be performed. These adjustments account for the presence of errors in the 
observations and increase the precision of the final values computed for the 
unknowns. When an adjustment is completed, all observations are corrected 
so that they are consistent throughout the survey network (i.e., the same values 
for the unknowns are determined no matter which corrected observation(s) 
are used to compute them). 

Many methods have been derived for making adjustments in surveying; 
however, the method of least squares should be used because it has significant 
advantages over all other rule-of-thumb procedures. The advantages of least 
squares over other methods can be summarized with the following four general 
statements: (1) it is the most rigorous of adjustments; (2) it can be applied with 
greater ease than other adjustments; (3) it enables rigorous post-adjustment 
analyses to be made; and (4) it can be used to perform presurvey planning. 
These advantages are discussed further below. 

The least squares method is rigorously based on the theory of mathematical 
probability, whereas in general, the other methods do not have this rigorous 
base. As described later in the book, in a least squares adjustment, the 
following condition of mathematical probability is enforced: The sum of the 
squares of the errors times their respective weights are minimized. By enforcing 
this condition in any adjustment, the set of errors that is computed has the 
highest probability of occurrence. Another aspect of least squares adjustment 
that adds to its rigor is that it permits all observations, regardless of their 
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number or type, to be entered into the adjustment and used simultaneously 
in the computations. Thus, an adjustment can combine distances, horizontal 
angles, azimuths, zenith or vertical angles, height differences, coordinates, 
and even GNSS observations. One important additional asset of least squares 
method is that it enables relative weights to be applied to the observations in 
accordance with their expected relative reliabilities. These reliabilities are based 
on expected precisions. Thus, if distances were observed in the same survey by 
pacing, taping, and using an EDM instrument, they could all be combined in 
an adjustment by assigning appropriate relative weights. 

Years ago, because of the comparatively heavy computational effort 
involved in least squares, nonrigorous or so-called rule-of-thumb adjustments 
were most often applied. However, now because computers have eliminated 
the computational expense, the reverse is true and least squares adjustments 
are performed more easily than these rule of thumb techniques. Least squares 
adjustments are less complicated because the same fundamental principles are 
followed regardless of the type of survey or the kind of observations. Also, the 
same basic procedures are used regardless of the geometric figures involved 
(e.g., triangles, closed polygons, quadrilaterals, or other more complicated 
networks). Rules of thumb, on the other hand, are not the same for all types 
of surveys (e.g., level nets use one rule and traverses use another), and the 
rules vary for different geometric shapes of each. Furthermore, the rule of 
thumb applied for a particular survey by one surveyor may be different from 
that applied by another surveyor. A favorable characteristic of least squares 
adjustments is that there is only one rigorous approach to the procedure, and 
thus no matter who performs the adjustment for any particular survey, the 
same results are obtained. 

Least squares has the advantage that after an adjustment has been finished, 
a complete statistical analysis can be made of the results. Based on the sizes 
and distribution of the errors, various tests can be conducted to determine 
if a survey meets acceptable tolerances or whether the observations must be 
repeated. If blunders exist in the data, these can be detected and eliminated. 
Least squares enables precisions for the adjusted quantities to be determined 
easily, and these precisions can be expressed in terms of error ellipses for clear 
and lucid depiction. Procedures for accomplishing these tasks are described in 
subsequent chapters. 

Besides its advantages in adjusting survey data, least squares can be used 
to plan surveys. In this application, prior to conducting a needed survey, sim¬ 
ulated surveys can be run in a trial-and-error procedure. For any project, an 
initial trial geometric figure for the survey is selected. Based on the figure, 
trial observations are either computed or scaled. Relative weights are assigned 
to the observations in accordance with the precisions that are estimated by 
considering the different combinations of equipment and held procedures. A 
least squares adjustment of this initial network is then performed, and the 
results analyzed. If goals have not been met, the geometry of the figure and the 
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observation precisions are varied and the adjustment performed again. In this 
process, different types of observations can be used and observations can 
be added or deleted. These different combinations of geometric figures and 
observations are varied until one is achieved that produces either optimum or 
satisfactory results. The survey crew can then proceed to the held, confident 
that if the project is conducted according to the optimum design, satisfactory 
results will be obtained. This technique of applying least squares in survey 
planning is discussed further in later chapters. 


1.8 OVERVIEW OF THE BOOK 

In the remainder of the book, the interrelationship between observational 
errors and their adjustment is explored. In Chapters 2 through 5, methods used 
to determine the reliability of observations are described. In these chapters, the 
ways that errors of multiple observations tend to be distributed are illustrated, 
and techniques used to compare the quality of different sets of observed values 
are examined. In Chapters 6 through 9 and in Chapter 13, methods used to 
model error propagation in observed and computed quantities are discussed. 
In particular, error sources present in traditional surveying techniques are 
examined, and the ways these errors propagate throughout the observational 
and computational processes are explained. In Chapters 21 and 25, methods 
used to locate blunders in sets of observations after an adjustment is explored. 
In the remainder of the book, the principles of least squares are applied to 
adjust observations in accordance with random error theory, and techniques 
used to locate mistakes in observations are examined. 


PROBLEMS 

Note: Partial answers to problems marked with an asterisk are given in 
Appendix H. 

1.1 Describe the steps involved in accounting for the existence of errors in 
observations. 

1.2 List two examples of direct measurements. 

1.3 List two examples of indirect measurements. 

1.4 List four unconditional statements about measurements. 

1.5 Define the sources of errors and provide an example of each. 
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1.6 


1.7 

1.8 


1.9 

1.10 


1.11 

1.12 


*1.13 

1.14 

1.15 

1.16 


State whether the following are mistakes, systematic errors, or random 
errors. 

(a) Earth curvature and refraction. 

(b) Imperfect centering over a point. 

*(c) Contraction of a tape due to a temperature other than standard. 

(d) Recording a length of 135.48 as 135.44. 

(e) Reading of the horizontal circle on a total station. 

Discuss the difference between a mistake and an error. 

Give an example of 

(a) a random instrumental error. 

(b) a random natural error. 

(c) a random personal error. 

Define the term discrepancy. 

Identify each of the following errors as either systematic or random. 

(a) Bubble not centered at the instance of reading a rod. 

(b) A vertical circle indexing error on a total station. 

*(c) Use of a tape that is not of standard length. 

(d) Reading the graduated horizontal circle on a total station. 

Define precision and accuracy. 

Identify each of the following errors according to its source (natural, 
instrumental, personal): 

*(a) Level rod length. 

(b) EDM reflector constant. 

(c) Air pressure in an EDM observation. 

(d) Reading a graduation on a level rod. 

(e) Earth curvature in leveling observations. 

(f) An inclined line of sight in an automatic level. 

The calibrated length of a particular line is 199.998 m. A length 
of 200.001 m is obtained using an EDM. What is the error in the 
observation? 

In Problem 1.13, if the observed length is 199.996 m, what is the error 
in the observation? 

Why do surveyors measure angles using both faces of a total station 
(i.e., direct and reversed)? 

List two examples of redundant observations in surveying. 
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1.17 Discuss the importance of making redundant observations in 
surveying. 

1.18 A line is observed as 156.58 ft, 156.60 ft, and 156.61 ft. How many 
redundant observations were observed? 

1.19 Why do prudent surveyors always obtain redundant measurements? 

1.20 What mathematical condition is enforced in a least squares 
adjustment? 

1.21 List the advantages that the least squares method has over rule-of- 
thumb adjustment procedures. 


CHAPTER 2 


OBSERVATIONS AND THEIR ANALYSIS 


2.1 INTRODUCTION 

Sets of data can be represented and analyzed using either graphical or numer¬ 
ical methods. Simple graphical analyses to depict trends commonly appear in 
newspapers or on television. A plot of the daily variation of the closing Dow 
Jones industrial average over the past year is an example. A bar chart showing 
daily high temperatures over the past month is another. Also, data can be 
presented in numerical form and be subjected to numerical analysis. Instead of 
using the bar chart, the daily high temperatures could be tabulated and their 
mean computed. In surveying, observational data can also be represented and 
analyzed either graphically or numerically. In this chapter, some rudimentary 
methods for doing so are discussed. 


2.2 SAMPLE VERSUS POPULATION 

Due to time and financial constraints in statistical analyses, generally, 
only a small sample of data is collected from a much larger, possibly infinite 
population. For example, political parties may wish to know the percentage 
of voters who support their candidate. It would be prohibitively expensive to 
query the entire voting population to obtain the desired information. Instead, 
polling agencies select a subset of voters from the voting population. This is an 
example of population sampling. 
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As another example, suppose that an employer wishes to determine the rel¬ 
ative measuring capabilities of two prospective new employees. The candidates 
could theoretically spend days or even weeks demonstrating their abilities. 
Obviously, this would not be very practical, so instead, the employer could 
have each person record a sample of readings, and from the readings predict 
the person’s abilities. For instance, the employer could have each candidate 
read a micrometer 30 times. The 30 readings would represent a sample of the 
entire population of possible readings. In fact, in surveying, every time that 
distances, angles, or elevation differences are measured, samples are being 
collected from an infinite population of measurements. 

From the preceding discussion, the following definitions can be made: 

1. Population. A population consists of all possible measurements that can 
be made on a particular item or procedure. Often, a population has an 
infinite number of data elements. 

2. Sample. A sample is a subset of data selected from the population. 

2.3 RANGE AND MEDIAN 

Suppose that a one-second (1") micrometer theodolite is used to read a direc¬ 
tion 50 times. The second’s portions of the readings are shown in Table 2.1. 
These readings constitute what is called a data set. Flow can these data be orga¬ 
nized to make them more meaningful? Flow can one answer the question: Are 
the data representative of readings that should reasonably be expected with 
this instrument and a competent operator? What statistical tools can be used 
to represent and analyze this data set? 

One quick numerical method used to analyze data is to compute its range, 
also called dispersion. Range is the difference between the highest and lowest 
values. It provides an indication of the precision of the data. From Table 2.1, the 
lowest value is 20.1 and the highest is 26.1. Thus, the range is 26.1-20.1, or 6.0. 


TABLE 2.1 Fifty Readings 


22.7 

22.3 

25.5 

23.8 

22.9 

22.2 

21.9 

26.1 

22.6 

21.7 


25.4 

24.2 

24.7 

24.4 

23.4 

23.3 

24.3 

21.2 

25.3 

23.9 


24.0 

24.8 

23.2 

23.7 

25.9 

24.6 

23.8 
23.0 
25.0 

22.3 


20.5 

23.5 
22.0 

24.1 

23.1 

24.1 

23.1 

25.9 
22.8 

25.3 


22.5 

22.9 

23.8 

22.6 

21.8 

23.2 

25.2 
22.8 

23.6 

20.1 
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The range for this data set can be compared with ranges of other sets, but this 
comparison has little value when the two sets differ in size. For instance, would 
a set of 100 data points with a range of 8.5 be better than the set in Table 2.1? 
Clearly, other methods of statistically analyzing data sets would be useful. 

To assist in analyzing data, it is often helpful to list the values in order of 
increasing size. This was done with the data of Table 2.1 to produce the results 
shown in Table 2.2. By looking at this ordered set, it is possible to determine 
quickly the data’s middle value or midpoint. In this example, it lies between 
the values of 23.4 and 23.5. The midpoint value is also known as the median. 
Since there is an even number of values in this example, the median is given by 
the average of the two values closest to (which straddle) the midpoint. That is, 
the median is assigned the average of the 25th and 26th entries in the ordered 
set of 50 values, and thus for the data set of Table 2.2, the median is the average 
of 23.4 and 23.5 or 23.45. 


2.4 GRAPHICAL REPRESENTATION OF DATA 

[fill Although an ordered numerical tabulation of data allows for some data 
distribution analysis, it can be improved with a frequency histogram , usually 
simply called a histogram. Flistograms are bar graphs that show the frequency 
distributions in data. To create a histogram, the data are divided into classes. 
These are subregions of data that usually have a uniform range in values, or 
class width. Although there are no universally applicable rules for the selection 
of class width, generally 5 to 20 classes are used. 

As a rule of thumb, a data set of 30 values may have only 5 or 6 classes, 
whereas a data set of 100 values may have as many as 15 to 20 classes. In general, 
the smaller the data set, the lower the number of classes used. 

The histogram class width (range of data represented by each histogram bar) 
is determined by dividing the total range by the number of classes to be used. 
For example, consider the data of Table 2.2. If they were divided into seven 


TABLE 2.2 Data in Ascending Order 


20.1 

21.9 

22.5 
22.8 

23.1 

23.5 

23.8 

24.2 

24.8 

25.4 


20.5 
22.0 

22.6 

22.9 

23.2 

23.6 

23.9 

24.3 
25.0 

25.5 


21.2 

22.2 

22.6 

22.9 

23.2 

23.7 
24.0 

24.4 

25.2 

25.9 


21.7 

22.3 

22.7 
23.0 

23.3 

23.8 
24.1 

24.6 

25.3 

25.9 


21.8 

22.3 

22.8 

23.1 

23.4 

23.8 

24.1 

24.7 

25.3 

26.1 
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classes, the class width would be the range divided by the number of classes, or 
6.0/7 = 0.857, or 0.86. The first class interval is found by adding the class width 
to the lowest data value. For the data in Table 2.2, the first class interval is from 
20.1 to (20.1 + 0.86), or 20.96. This class interval includes all data from 20.1 up 
to, but not including, 20.96. The next class interval is from 20.96 up to (20.96 + 
0.86), or 21.82. Remaining class intervals are found by adding the class width 
to the upper boundary value of the preceding class. The class intervals for the 
data of Table 2.2 are listed in column (1) of Table 2.3. 

After creating class intervals, the number of data values in each interval is 
tallied. This is called the class frequency. Obviously, having data ordered con¬ 
secutively as shown in Table 2.2 aids greatly in this counting process. Column 
(2) of Table 2.3 shows the class frequency for each class interval of the data in 
Table 2.2. 

Often, it is also useful to calculate the class relative frequency for each 
interval. This is found by dividing the class frequency by the total number of 
observations. For the data in Table 2.2, the class relative frequency for the first 
class interval is 2/50 = 0.04. Similarly, the class relative frequency of the fourth 
interval (from 22.67 to 23.53) is 13/50 = 0.26. The class relative frequencies for 
the data of Table 2.2 are given in column (3) of Table 2.3. Notice that the sum 
of all class relative frequencies is always 1. The class relative frequency enables 
easy determination of percentages, which are called percentage points. For 
instance, the class interval from 21.82 to 22.67 contains 16% (0.16 x 100%) of 
the sample observations. 

A histogram is a bar graph plotted with either class frequencies or relative 
class frequencies on the ordinate, versus values of the class interval bounds on 
the abscissa. Using the data from Table 2.3, the histogram shown in Figure 2.1 
was constructed. Notice that in this figure, relative frequencies have been plot¬ 
ted as ordinates. 

Flistograms drawn with the same ordinate and abscissa scales can be used to 
compare two different data sets. If one data set is more precise than the other, it 


TABLE 2.3 Frequency Table 


(1) 

Class 

Interval 

(2) 

Class 

Frequency 

(3) 

Class Relative 
Frequency 

20.10-20.96 

2 

2/50 = 0.04 

20.96-21.82 

3 

3/50 = 0.06 

21.82-22.67 

8 

8/50 = 0.16 

22.67-23.53 

13 

13/50 = 0.26 

23.53-24.38 

11 

11/50 = 0.22 

24.38-25.24 

6 

6/50 = 0.12 

25.24-26.10 

7 

7/50 = 0.14 


o 

II 

£ = 50/50 = 1 
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Direction readings 


FIGURE 2.1 Frequency histogram. 


will have comparatively tall bars in the center of the histogram, with relatively 
short bars near its edges. Conversely, the less precise data set will yield a wider 
range of abscissa values, with shorter bars at the center. 

A summary of items seen easily on a histogram include: 

• Whether the data are symmetrical about a central value 

• The range or dispersion in the measured values 

• The frequency of occurrence of the measured values 

• The steepness of the histogram, which is an indication of measurement 
precision 

Figure 2.2 shows several possible histogram shapes. Figure 2.2(a) depicts a 
histogram that is symmetric about its central value with a single peak in the 
middle. Figure 2.2(b) is also symmetric about the center but has a steeper slope 
than Figure 2.2(a), with a higher peak for its central value. Assuming the ordi¬ 
nate and abscissa scales to be equal, the data used to plot Figure 2.2(b) are 
more precise than those used for Figure 2.2(a). Symmetric histogram shapes 
are common in surveying practice, as well as in many other fields. In fact, they 
are so common that the shapes are said to be examples of a normal distribution. 
In Chapter 3, the reasons why these shapes are so common are discussed. 

Figure 2.2(c) has two peaks and is said to be a bimodal histogram. In the 
histogram of Figure 2.2(d), there is a single peak with a long tail to the left. 
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FIGURE 2.2 Common histogram shapes. 


This results from a skewed data set, and in particular, these data are said to be 
skewed to the right. The data of histogram Figure 2.2(e) is skewed to the left. 

In surveying, the varying histogram shapes just described result from 
variations in personnel, physical conditions, and equipment. For example, 
repeated observations of a long distance made with an EDM instrument and 
by taping. By EDM procedure would probably produce data having a very 
narrow range, and thus the resulting histogram would be narrow and steep 
with a tall central bar like that in Figure 2.2(b). The histogram of the same 
distance measured by tape and plotted at the same scales would probably 
be wider with neither sides as steep nor the central value as great, like that 
shown in Figure 2.2(a). Since observations in surveying practice tend to be 
normally distributed, bimodal or skewed histograms from measured data 
are not expected. The appearance of such a histogram should lead to an 
investigation for the cause of this shape. For instance, if a data set from 
an EDM calibration plots as a bimodal histogram, it could raise questions 
about whether the instrument or reflector were moved during the measuring 
process, or if atmospheric conditions changed dramatically during the session. 
Similarly, a skewed histogram in EDM work may indicate the appearance of 
a weather front that stabilized over time. The existence of multipath errors in 
GNSS observations could also produce these types of histogram plots. 


2.5 NUMERICAL METHODS OF DESCRIBING DATA 

Numerical descriptors are values computed from a data set that are used 
to interpret the data’s precision or quality. Numerical descriptors fall into 
three categories: (1) measures of central tendency, (2) measures of data vari¬ 
ation, and (3) measures of relative standing. These categories are all called 
statistics. Simply described, a statistic is a numerical descriptor computed from 
sample data. 


2.6 MEASURES OF CENTRAL TENDENCY 

Measures of central tendency are computed statistical quantities that give 
an indication of the value within a data set that tends to exist at the center. 
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The arithmetic mean, median, and mode are three such measures. They are 
described as follows: 

1. Arithmetic mean: For a set of n observations, y 1 ,y 2 ,..., y„, the arithmetic 
mean is the average of the observations. It’s value, y, is computed from 
the following equation: 

n 

I* 

i= 1 


Typically, the symbol y is used to represent the sample’s arithmetic 
mean and the symbol // is used to represent the population mean. 
Otherwise, the same equation applies. Using Equation (2.1), the mean 
of the observations in Table 2.2 is 23.5. 

2. Median: As mentioned previously, this is the midpoint of a sample set 
when arranged in ascending or descending order. One-half of the data 
are above the median and one-half are below it. When there are an odd 
number of quantities, only one such value satisfies this condition. For 
a data set with an even number of quantities, the average of the two 
observations that straddle the midpoint is used to represent the median. 
Due to the relatively small number of observations in surveying, it is 
seldom used. 

3. Mode: Within a sample of data, the mode is the most frequently occur¬ 
ring value. It is seldom used in surveying because of the relatively small 
number of values observed in a typical set of observations. And in small 
sample sets, several different values may occur with the same frequency, 
and hence, the mode can be meaningless as a measure of central tendency. 
The mode for the data in Table 2.2 is 23.8. It is possible for a set of data 
to have more than one mode. A common example is a data set with two 
modes, which is said to be bimodal. 

2.7 ADDITIONAL DEFINITIONS 

Nine other terms, pertinent to the study of observations and their analysis, are 
listed and defined here: 

1. True value, fi: A quantity’s theoretically correct or exact value. As noted 
in Section 1.3, the true value can never be determined. 

2. Error, e: The error is the difference between any individual observed 
quantity and its true value. The true value is simply the population’s 
arithmetic mean if all repeated observations have equal precision. 
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Since the true value of an observed quantity is indeterminate, errors 
are also indeterminate and are therefore only theoretical quantities. 
As given in Equation (1.1), and repeated for convenience here, errors are 
expressed as 


(2.2) 


A = y i - h 


where y t is the individual observation associated with e ; , and /< is the true 
value for that quantity. 

3. Most probable value, y: The most probable value is that value for a 
measured quantity, which, based upon the observations, has the highest 
probability of occurrence. It is derived from a sample set of data rather 
than the population and is simply the mean, if the repeated observations 
have the same precision. 

4. Residual, v: A residual is the difference between any individual measured 
quantity and the most probable value for that quantity. Residuals are the 
values that are used in adjustment computations since most probable val¬ 
ues can be determined. The term error is frequently used when residual is 
meant, and although they are very similar and behave in the same man¬ 
ner, there is this theoretical distinction. The mathematical expression for 
a residual is 


(2.3) 


Vi=y-y t 


where r, is the residual in the z'th observation, y h and y is the most prob¬ 
able value for the unknown. 

5. Degrees of freedom: Also called redundancies, the degrees of freedom 
are the number of observations that are in excess of the number neces¬ 
sary to solve for the unknowns. In other words, the number of degrees of 
freedom equals the number of redundant observations (see Section 1.6). 
As an example, if a distance between two points is measured three times, 
one observation would determine the unknown distance and the other 
two are redundant. These redundant observations reveal the discrepan¬ 
cies and inconsistencies in observed values. This, in turn, makes possible 
the practice of adjustment computations for obtaining the most probable 
values based on the measured quantities. 

6. Variance, a 1 : This is a value by which the precision for a set of data 
is given. Population variance applies to a data set consisting of an 
entire population. It is the mean of the squares of the errors and is 
given by: 


n 



(2.4) 


n 
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Sample variance applies to a sample set of data. It is an unbiased 
estimate for the population variance given in Equation (2.4) and is 
calculated as: 

72 

I”? 

s 1 = (2.5) 

n — 1 

Note that Equations (2.4) and (2.5) are identical except that e has been 
changed to v, and n has been changed to (n — 1) in Equation (2.5). The 
validity of these modifications is demonstrated in Section 2.10. 

It is important to note that the simple algebraic average of all errors 
in a data set cannot be used as a meaningful precision indicator. This 
is because random errors are as likely to be positive as negative, and thus 
the algebraic average will equal zero. This fact is shown for a popula¬ 
tion of data in the following simple proof. Summing Equation (2.2) for n 
samples gives 

72 72 72 

X £ »■ = ~ & = X y i ~ >ni 

(=i i=i i=i 


Then substituting Equation (2.1) into Equation (a) yields: 


X £ ' = X- v '— 


1=1 


1=1 


In 

i=l 


= X"V-X'V = () 


1=1 


1=1 


(b) 


\ 7 


Similarly, it can be shown that the mean of all residuals of a sample 
data set equals zero. 

7. Standard error, a: This is the square root of the population variance. 
From Equation (2.4) and this definition, the following equation is written 
for the standard error: 

72 


(J = 



( 2 . 6 ) 


72 

where n is the number of observations and ^ e 2 is the sum of the 

i=i 

squares of the errors. Note that the population variance, a 2 , and stan¬ 
dard error, a, are indeterminate because true values, and hence errors, 
are indeterminate. 
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As will be explained in Section 3.5, 68.3% of all observations in a 
population data set lie within ±a of the true value, /<. Thus, the larger 
the standard error, the more dispersed are the values in the data set and 
the less precise is the measurement. 

8. Standard deviation , S: This is the square root of the sample variance. It is 
calculated using the following expressions 


5 = 


A 


X”? 

i=\ 

n — 1 


(2.7) 


where S is the standard deviation, n - 1 the degrees of freedom, and ^ v 2 

i— 1 

the sum of the residuals squared. Standard deviation is an estimate for 
the standard error of the population. Since the standard error cannot 
be determined, the standard deviation is a practical expression for the 
precision of a sample set of data. Residuals are used rather than errors 
because they can be calculated from most probable values whereas errors 
cannot be determined. As discussed in Section 3.5 for a sample set of 
data, 68.3% of the observations will theoretically he between the most 
probable value plus and minus the standard deviation, S. The meaning 
of this statement will be clarified in example that follows. 

9. Standard deviation of the mean: Because all observed values contain 
errors, the mean, which is computed from a sample set of measured 
values, will also contain error. The standard deviation of the mean is 
computed from the sample standard deviation according to the following 
equation: 

Sy — ±—p (2.8) 

V« 

Notice that as n approaches infinity, S- approaches 0. This illustrates 
that as the size of the sample set approaches the total population, the 
computed mean y will approach the true mean //. This equation is derived 
in Section 6.2.3. 


2.8 ALTERNATIVE FORMULA FOR DETERMINING VARIANCE 

From the definition of residuals, Equation (2.5) is rewritten as 

S 2 = — --- (2.9) 

n - 1 
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Expanding Equation (2.9) yields 

s 2 = -^-r [(.y-yi) 2 + (y-y 2 ) 2 + ■■■ + $-y*) 2 } 

n - 1 1 1 


(c) 


Substituting Equation (2.1) for y into Equation (c), and dropping the 
bounds for the summation, 


S 2 = 1 


- 1 


Y /Z* 


_ >’i I +1- y 2 I + • • • + 




-y„ 


id) 


Expanding Equation (d). 


S 2 = 1 


n— 1 


- 2ri Zy +yl JZy) _ 2yi hi 

n J n \ n J n 

, /Z- v A~ » Z yt 2 

+ • • • + ( - - 2y n - +y 2 n 

z \ n I n 


(e) 


Rearranging Equation (e) and recognizing that 


Z y ‘ 


occurs n times in 


Equation (e) yields 


,S 2 = 1 


- 1 


Z^Y „Z*, 2 2 2 

_ -Oh + y 2 + • • • + y n ) + )’i + >2 + • • • + y n 


n / n 


Adding the summation symbol to Equation (/) yields 

2 


s 2 = 1 


-1 


(Y)Y( 5 » 2 + 2 >? 


(/) 


(&) 


Factoring and regrouping similar summations in Equation (g) produces 


^2 




n— 1 


I^-(?-I)(i,,)%^t[I 2 ?-I(e„) 


(h) 


Multiplying the last term in Equation (h) by nln yields 


n — 1 


Z yf~ n ( 


(0 
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Finally by substituting Equation (2.1) in Equation (z), the following 
expression for the variance results: 


,S 2 = 


n - 1 


( 2 . 10 ) 


Using Equation (2.10), the variance of a sample data set can be computed 
by subtracting n times the square of the data’s mean from the summation of 
the squared individual observations. With this equation, the variance and the 
standard deviation can be computed directly from the data. Elowever, it should 
be stated that with large numerical values, Equation (2.10) may overwhelm 
a hand-held calculator or a computer working in single precision. The data 
should be centered or Equation (2.5) used when this problem arises. Centering 
a data set involves subtracting a constant value (usually, the arithmetic mean 
or something near the mean) from all values in a data set. By doing this, the 
values are modified to a smaller, more manageable size. 


2.9 NUMERICAL EXAMPLES 

Example 2.1 Using the data from Table 2.2, determine the sample set’s mean, 
median, and mode and the standard deviation using both Equations (2.7) and 
(2.10). Also plot its histogram. (Recall that the data of Table 2.2 result from 
the second’s portion of 50 total station directions.) 

SOLUTION Mean: From Equation (2.1) and using the ^ y, value from 
Table 2.4, we have 

50 

X 

i= i 1175 c „ 


Median: Since there is an even number of observations, the data’s midpoint 
lies between the values that are numerically 25th and 26th from the beginning 
of the ordered set. These values are 23.4 and 23.5, respectively. Averaging these 
observations yields 23.45". 

Mode: The mode, which is the most frequently occurring value, is 23.8". 
It appears three times in the sample. 

Range, class width, histogram: These data were developed in Section 2.4, 
with the histogram plotted in Figure 2.1. 

Standard deviation: Table 2.4 lists the residuals [computed using Equation 
(2.3)], and their squares, for each observation. 
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TABLE 2.4 Data Arranged for the Solution of Example 2.1 


No. 

y 

V 

V 2 

No. 

y 

V 

V 2 

No. 

y 

V 

V 2 

No. 

y 

V 

V 2 

1 

20.1 

3.4 

11.56 

13 

22.6 

0.9 

0.81 

25 

23.4 

0.1 

0.01 

38 

24.4 

-0.9 

0.81 

2 

20.5 

3.0 

9.00 

14 

22.7 

0.8 

0.64 

26 

23.5 

0.0 

0.00 

39 

24.6 

-1.1 

1.21 

3 

21.2 

2.3 

5.29 

15 

22.8 

0.7 

0.49 

27 

23.6 

-0.1 

0.01 

40 

24.7 

-1.2 

1.44 

4 

21.7 

1.8 

3.24 

16 

22.8 

0.7 

0.49 

28 

23.7 

-0.2 

0.04 

41 

24.8 

-1.3 

1.69 

5 

21.8 

1.7 

2.89 

17 

22.9 

0.6 

0.36 

29 

23.8 

-0.3 

0.09 

42 

25.0 

-1.5 

2.25 

6 

21.9 

1.6 

2.56 

18 

22.9 

0.6 

0.36 

30 

23.8 

-0.3 

0.09 

43 

25.2 

-1.7 

2.89 

7 

22.0 

1.5 

2.25 

19 

23.0 

0.5 

0.25 

31 

23.8 

-0.3 

0.09 

44 

25.3 

-1.8 

3.24 

8 

22.2 

1.3 

1.69 

20 

23.1 

0.4 

0.16 

32 

23.9 

-0.4 

0.16 

45 

25.3 

-1.8 

3.24 

9 

22.3 

1.2 

1.44 

21 

23.1 

0.4 

0.16 

33 

24.0 

-0.5 

0.25 

46 

25.4 

-1.9 

3.61 

10 

22.3 

1.2 

1.44 

22 

23.2 

0.3 

0.09 

34 

24.1 

-0.6 

0.36 

47 

25.5 

-2.0 

4.00 

11 

22.5 

1.0 

1.00 

23 

23.2 

0.3 

0.09 

35 

24.1 

-0.6 

0.36 

48 

25.9 

-2.4 

5.76 

12 

22.6 

0.9 

0.81 

24 

23.3 

0.2 

0.04 

36 

24.2 

-0.7 

0.49 

49 

25.9 

-2.4 

5.76 









37 

24.3 

-0.8 

0.64 

50 

26.1 

-2.6 

6.76 













z= 

1175 

0.0 

92.36 


From Equation (2.7) and using the value of 92.36 from Table 2.4 as the 
sum of the squared residuals, the standard deviation for the sample set is com¬ 
puted as 


S = 



92.36 
50- 1 


±1.37" 


Summing the squared j-values of Table 2.4 yields 

= 27,704.86 


Using Equation (2.10), the standard deviation for the sample set is 


S = 



/27,704.86-50(23.5) 2 

V 50- 1 


/ 92.36 

V 49 


±1.37" 


By demonstration in Example 2.1, it can be seen that Equations (2.7) and 
(2.10) will yield the same standard deviation for a sample set. Notice that the 
number of observations within a single standard deviation from the mean, that 
is, between (23.5" - 1.37") and (23.5" + 1.37"), or between 22.13" and 24.87", 
is 34. This represents 34/50 x 100% or 68% of all observations in the sample and 
matches the theory noted earlier. Also note that the algebraic sum of residuals 
is zero as was earlier demonstrated by Equation ( b ). 




















26 OBSERVATIONS AND THEIR ANALYSIS 


The histogram, shown in Figure 2.1, plots class relative frequencies versus 
class values. Notice how the values tend to be grouped about the central point. 
This is an example of a precise data set. 

Example 2.2 The data set shown below also represents the seconds’ portion 
of 50 observations of a direction. Compute the mean, median, and mode, and 
use Equation (2.10) to determine the standard deviation. Also construct a his¬ 
togram. Compare the data of this example with those of Example 2.1. 


34.2 

33.6 

35.2 

30.1 

38.4 

34.0 

30.2 

34.1 

37.7 

36.4 

37.9 

33.0 

33.5 

35.9 

35.9 

32.4 

39.3 

32.2 

32.8 

36.3 

35.3 

32.6 

34.1 

35.6 

33.7 

39.2 

35.1 

33.4 

34.9 

32.6 

36.7 

34.8 

36.4 

33.7 

36.1 

34.8 

36.7 

30.0 

35.3 

34.4 

33.7 

34.1 

37.8 

38.7 

33.6 

32.6 

34.7 

34.7 

36.8 

31.8 


SOLUTION Table 2.5, which arranges each observation and its square in 
ascending order, is first prepared. 


TABLE 2.5 Data Arranged for the Solution of Example 2.2 


No. 

y 

v 2 

No. 

y 

y 2 

No 

y 

y 2 

No. 

y 

y 2 

1 

30.0 

900.00 

13 

33.5 

1122.25 

25 

34.7 

1204.09 

38 

36.3 

1317.69 

2 

30.1 

906.01 

14 

33.6 

1128.96 

26 

34.7 

1204.09 

39 

36.4 

1324.96 

3 

30.2 

312.04 

15 

33.6 

1128.96 

27 

34.8 

1211.04 

40 

36.4 

1324.96 

4 

31.8 

1011.24 

16 

33.7 

1135.69 

28 

34.8 

1211.04 

41 

36.7 

1346.89 

5 

32.2 

1036.84 

17 

33.7 

1135.69 

29 

34.9 

1218.01 

42 

36.7 

1346.89 

6 

32.4 

1049.76 

18 

33.7 

1135.36 

30 

35.1 

1232.01 

43 

36.8 

1354.24 

7 

32.6 

1062.76 

19 

34.0 

1156.00 

31 

35.2 

1239.04 

44 

37.7 

1421.29 

8 

32.6 

1062.76 

20 

34.1 

1162.81 

32 

35.3 

1246.09 

45 

37.8 

1428.84 

9 

32.6 

1062.76 

21 

34.1 

1162.81 

33 

35.3 

1246.09 

46 

37.9 

1436.41 

10 

32.8 

1075.84 

22 

34.1 

1162.81 

34 

35.6 

1267.36 

47 

38.4 

1474.56 

11 

33.0 

1089.00 

23 

34.2 

1169.64 

35 

35.9 

1288.81 

48 

38.7 

1497.69 

12 

33.4 

1115.56 

24 

34.4 

1183.36 

36 

35.9 

1288.81 

49 

39.2 

1536.64 







37 

36.1 

1303.21 

50 

39.3 

1544.49 










1737.0 

60,584.48 


,, _ Yi y ‘ 1737.0 

Mean: y - —— =-= 34.74 

» 50 

Median: The median is between the 25th and 26th values, which are both 
34.7". Thus, the median is 34.7". 
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TABLE 2.6 Frequency Table for Example 2.2 


Class 

Class 

Frequency 

Class Relative 
Frequency 

29.15-30.01 

1 

0.02 

30.01 - 30.87 

2 

0.04 

30.87-31.73 

0 

0.00 

31.73-32.59 

3 

0.06 

32.59-33.45 

6 

0.12 

33.45- 34.31 

11 

0.22 

34.31 -35.17 

7 

0.14 

35.17- 36.03 

6 

0.12 

36.03-36.89 

7 

0.14 

36.89-37.75 

1 

0.02 

37.75- 38.61 

3 

0.06 

38.61 -39.47 

3 

0.06 


1 = 50 

1 = 1.00 


Mode: The data have three different values that occur with a frequency of 3. 
Thus, the modes for the data set are the three values 32.6", 33.7", and 34.1". 

Range: The range of the data is 39.3" - 30.0" = 9.3". 

Class width: For comparison purposes, the class width of 0.86 is taken since 
it was used for the data in Table 2.2. Since it is desired that the histogram 
be centered about the data’s mean value, the central interval is determined 
by adding and subtracting one-half of the class width (0.43") to the mean. 
Thus, the central interval is from (34.74" - 0.43"), or 34.31", to (34.74" + 
0.43"), or 35.17". To compute the remaining class intervals, the class width 
is subtracted, or added, to the bounds central interval as necessary until all 
the data are contained within the bounds of the intervals. Thus, the interval 
immediately preceding the central interval will be from (34.31" - 0.86"), or 
33.45", to 34.31", and the interval immediately following the central interval 
will be from 35.17" to (35.17" + 0.86"), or 36.03". In a similar fashion, the 
remaining class intervals were determined, and a class frequency chart was con¬ 
structed as shown in Table 2.6. Using this table, the histogram of Figure 2.3 was 
constructed. 

Variance: By Equation (2.10), using the sum of observations squared in 
Table 2.5, the sample variance is 

c2 _^L y2 i~ n y 2 _ 60, 584.48 - 50(34.74) 2 _ , 
n- 1 50-1 

and the sample standard deviation is 


S' = V^92 = ±2.22" 
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FIGURE 2.3 Histogram for Example 2.2. 


The number of observations that actually fall within the bounds of the mean 
±S (i.e., between 34.74" ±2.22") is 30. This is 60% of all the observations and 
closely approximates the theoretical value of 68.3%. These bounds and the 
mean value are shown as dashed lines in Figure 2.3. 

Comparison : The data set of Example 2.2 has a larger standard deviation 
(±2.22") than that of Example 2.1 (±1.37"). The range for the data of Example 
2.2 (9.3") is also larger than that of Example 2.1 (6.0"). Thus, the data set of 
Example 2.2 is less precise than that of Example 2.1. A comparison of the two 
histograms shows this precision difference graphically. For example, note that 
the histogram in Figure 2.1 is narrower in width and taller at the center than 
the histogram in Figure 2.3. 


2.10 ROOT MEAN SQUARE ERROR AND MAPPING STANDARDS 

Today maps can be obtained in hardcopy and digital form. Thus, modern map 
accuracy standards are often based a statistical quantity known as the root 
mean square error (RMSE). In order to check the accuracy of a map, it is 
required to determine the discrepancy between the coordinates as determined 
from points on a map versus those same points observed with a higher-order 
check survey. Obviously, these points must be well-defined on the map and on 
the surface of the earth in order to obtain coordinate values in the same loca¬ 
tions during the held survey. 
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Since the check survey must be of higher accuracy than the map, these 
discrepancies are often considered to be residuals where the results of the 
check survey are considered to be without error, and thus represent the true 
values. This concept of values determined from a higher-order survey being 
considered true values is not without precedence. For example, the distances 
listed on the coordinate datasheet for a station or the lengths listed on an 
EDM calibration baseline report are often considered the true values since 
the surveys determining these values are considered to be more accurate than 
what a typical held survey would yield. 

RMSE is defined as the square root of the average of squared residuals 
for values tested. Thus, for map accuracy standards, the differences between 
coordinates and elevations of points obtained from a map and their values as 
determined by a check survey are used to determine the accuracies of the map. 
Mathematically, RMSE is denoted as 


RMSE = 



~ x i \ 2 

n 


( 2 . 11 ) 


where n is the number of tested samples from the map, /(.vj is the position of 
the point obtained from the map, x t is the position obtained from the check 
survey, and /(a,) - x t the residual error for the point. 

As an example consider the data shown in Table 2.7. The map coor¬ 
dinate values for the well-defined points are shown in columns (1) - (3). 
The check survey coordinate values are shown in columns (4) - (6). The 
discrepancies shown in columns (7) - (9) are computed as the difference 
between the mapped and surveyed coordinate values, which are listed as 
residuals. Thus, the residual for the x coordinate of point 1 is computed as 
672,571.819 - 672,571.777 = 0.042 m. Similarly all other coordinate differences 
are determined. 

The standard deviations for each coordinate type are computed as 


Sae — 


$an ~ 


SAll ~ 



0.017378 

19 


0.007031 

19 


0.033783 


= ±0.030 m 

= ±0.019 m 

= ±0.042 m 
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Using Equation (2.11), the RMSE in AE (RMSE A£ ), AN (RMSE^), and AH 
(RMSE a// ) are computed from their corresponding residuals as 

„^ cr , \ / E V i/1, /0.017378 AA ™ 

RMSE - = V 20 = V 20 = ±0 - 029 m 

DMec JE^i / 0.007031 AA]n 

RMSE A7V = Y 0Q = Y —20— = ±0 '° 9 m 

„ A/rcr , A /Z v a//, /0.033783 AA(11 

RMSE ^ = V 20 = V 20 = °' 041 m 

From the RMSE A/ . and RMSE AAr , a radial value for the horizontal posi¬ 
tional accuracy is determined as 

RMSE,. = yWsE^ + RMSE^, = Vo.029 2 + 0.019 2 = 0.035 m 

Following these computations, standards usually require a certain confidence 
level for the horizontal and vertical components of the map. 

2.11 DERIVATION OF THE SAMPLE VARIANCE 
(BESSEL’S CORRECTION) 

Recall from Section 2.7 that the denominator of the equation for sample 
variance was n — 1, while the denominator of the population variance was n. 
A simple explanation for this difference is that one observation is necessary 
to compute the mean (y), and thus, only n - I observations remain for the 
variance’s computation. A derivation of Equation (2.5) will clarify. 

Consider a sample size of n drawn from a population with a mean, /i, and 
standard error of a. Let v, be an observation from the sample, then 

u - /' = (u -y) + (y~ a0 

= t Vi-y) + e (J) 

where e = (y - n) is the error or deviation of the sample mean. Squaring and 
expanding Equation (j) yields 

(J; - h) 2 = (Ji ~ y) 2 + £ 2 + 2e(ji - y) 

Summing all the observations in the sample from i equaling 1 to n yields 

n n n 

X O'/ - A') 2 = - y ) 2 + «e 2 + 2e Ypi - y) 

1=1 1=1 1=1 


(k) 
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Since by definition of the sample mean y 

n n n n 

^ J (yi-y) = ^y i -ny=^ J y i -^y i = 0 (/) 

i— 1 i=\ i= 1 i= 1 

Equation ( k) becomes 

n n 

X o ’i - A ') 2 = £ (y'i - y ) 2 + ne 2 (m) 

i=i i=i 

Repeating this calculation for many samples, the mean value of the 
left-hand side of Equation (m) will (by definition of er 2 ) tend to no 2 . Similarly, 
by Equation (2.8), the mean value of ne 2 = n(j.i -y) 2 will tend to n times the 
variance of y since e represents the deviation of the sample mean from the 
population mean. Thus, ne 2 —> n(o 2 /n) where a 2 /« is the variance in y as 
n -*■ oo. The above discussion and Equation (in) results in 

n 

no 2 ->■ Yj & ~ yf +w 

i= 1 

Rearranging Equation (n) produces 

n 

^i(yj-y ) 2 -> (n- \)o 2 ( o) 

i =1 

Thus, from Equation (o) and recognizing the left side of the equation as 
(n - IIS' 2 for a sample set of data, it follows that 


i— 1 


In other words, for a large number of random samples, the value of 

n 

y (hi — y) 2 / ( n — 1) tends to o 2 . That is, S 2 is an unbiased estimate of the 

i=i 

population’s variance. 


2.12 SOFTWARE 

A Windows-based, statistical software package called STATS is available 
on the companion website for this book. It can be used to quickly perform 
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statistical analysis of data sets as presented in this chapter. The data hie used 
in STATS is simply a listing of the individual observations. For example, in 
Example 2.1, the data hie can be entered as it is shown in Table 2.1. After 
saving this hie, the “Flistogram data” option under the programs menu is 
selected. After entering the appropriate hie into the software, the software 
performs the computations discussed in this chapter and plots a frequency 
histogram of the data using the user-specihed class interval or the desired 
number of classes. 

Additionally, an electronic book is provided on the companion website for 
this book. To view the electronic book interactively, the Mathcad® software is 
required. Flowever for those you do not have a copy of Mathcad®, html hies of 
the electronic book are also on the website. The electronic book demonstrates 
most of the numerical examples provided in this book. In particular, the elec¬ 
tronic book c2. xmcd demonstrates the use of Mathcad® 1 to solve Examples 2.1 
and 2.2. 

Also, a spreadsheet can be used to perform the computations in this 
chapter. For example, Microsoft Excel® has functions for determining the 
mean, median, mode, standard deviation, and histogram data. The average 
function computes the mean for a selected set of data. The stdev.s function 
computes the standard deviation for a selected sample set of data. Similarly, 
the mode and median functions determine these values for a set of data, and the 
min and max functions determine the minimum and maximum values for the 
data. Additionally, with an available plug-in, the software can automatically 
histogram the data based on the first number of the class intervals, which is 
known as a bin number. These functions are demonstrated for Example 2.1 in 
the hie c2. xls on the companion website. 

Many of the chapters have programming problems listed at the end of each 
chapter. The electronic book demonstrates the rudiments of programming 
these problems. Other programs on the companion website include MATRIX 
and ADJUST. MATRIX can be used to solve problems involving matrices in 
this book. ADJUST has working least squares adjustment examples discussed 
in this book. ADJUST can be used to check solutions of many of the problems 
in this book. 

The installation software for the programs ADJUST, MATRIX, and STATS 
is available in the zip hie on the website. This software is available as an aid 
in learning the material in this book. Purchasers of this book may install this 
software on their computers. The spreadsheet and worksheet hies discussed in 
this book can be copied from the companion website to your computer. The 
Mathcad® e-book should be copied to the handbook subdirectory of the Math¬ 
cad program. If you do not own Mathcad, html hies of the e-book are provided, 
which can be copied viewed once you’ve unpacked the zipped archive from the 
companion website. Readers should refer to Appendix G for specihc details 
about the software on the website. 
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PROBLEMS 

Note: Partial answers to problems marked with an asterisk are given in 
Appendix H. 

* 2.1 The optical micrometer of a precise differential level is set and read 10 
times as 8.801, 8.803, 8.798, 8.801, 8.799, 8.802, 8.802, 8.804, 8.800, 
and 8.802. What value would you assign to the operator’s ability to set 
micrometer on this instrument? 

2.2 A distance measured in units of meters is observed 10 times as 186.499, 
186.498,186.495,186.499,186.498,186.489,186.489,186.498,186.500, 
and 186.491. What is the: 

(a) Range of the data? 

(b) Mean? 

(c) Median? 

*(d) Mode? 

2.3 Using the data in Problem 2.2 tabulate the residuals and compute the 
variance, standard deviation, and standard deviation of the mean. 

2.4 The second’s portion of 10 pointings and readings for a particular 
direction 26.5, 27.4, 31.5, 27.4, 24.8, 25.7, 33.1, 29.0, 28.8, and 26.0. 
What is the: 

*(a) Largest discrepancy in the data? 

(b) Mean? 

(c) Median? 

(d) Mode? 

2.5 Using the data in Problem 2.4, tabulate the residuals and compute the 
variance, standard deviation, and standard deviation of the mean. 

2.6 The second’s portion of 32 pointings and readings for a particular 
direction made using a 1" total station with a 0.1" display are: 48.9, 
48.8, 48.6, 49.0, 48.9, 47.8, 47.8, 48.8, 49.1, 48.0, 48.0, 48.2, 48.9, 48.6, 
48.8, 48.9, 48.2, 48.5, 48.5, 49.1, 48.6, 47.8, 47.8, 48.1, 49.0, 48.0, 49.1, 
48.4,47.9,48.2,47.9, and 48.1. 

(a) What is the mean of the data set? 

(b) Construct a frequency histogram of the data using seven 
uniform-width class intervals. 

*(c) What are the variance and standard deviation of the data? 

(d) What is the standard deviation of the mean? 

2.7 An EDM instrument and reflector are set at the ends of a baseline that 
is 200.014 m long. Its length is measured 21 times, with the following 
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results: 200.014, 200.013, 200.007, 200.016, 200.011, 200.015, 200.012, 
200.018,200.014,200.012,200.011,200.009,200.019,200.016,200.009, 
200.016, 200.015, 200.018, 200.016, 200.007, and 200.014. 

(a) What are the mean, median, and standard deviation of the data? 

(b) Construct a histogram of the data with seven intervals and 
describe its properties. On the histogram lay off the sample 
standard deviation from both sides of the mean. 

(c) How many observations are between y ± S, and what percentage 
of observations does this represent? 

2.8 Answer Problem 2.7 with the following additional observations. 
200.009, 200.015, 200.010, 200.016, 200.010, and 200.011. 

2.9 Answer Problem 2.8 with the following additional observations. 
200.010, 200.016, 200.016, and 200.015. 

2.10 A distance was measured in two parts with a 100-ft. steel tape and then 
in its entirety with a 200-ft. steel tape. Five repetitions were made by 
each method. What are the mean, variance, and standard deviation for 


each method of measurement? 

Distance measured with 100-ft tape 

Distances measured with 200-ft tape 

Section 1 

100.006, 100.004, 100.001, 100.006, 
100.005 

Section 2 

86.777, 86.779, 86.785, 86.778, 86.774 

186.778, 186.776, 186.781, 186.786, 
186.782 


2.11 Repeat Problem 2.10 using the following additional data for the 200-ft 
taped distance. 186.781, 186.784, 186.779, 186.778, and 186.776. 

2.12 During a triangulation project, an observer made 16 readings for each 
direction. The seconds portion of the directions to Station Orion are 
listed 26.9, 27.5, 27.1, 26.5, 25.6, 27.2, 27.4, 26.6, 26.9, 26.1, 27.4, 27.3, 
27.7, 26.4, 28.4, and 27.4. 

(a) Using a 0.5" class interval, plot the histogram using relative 
frequencies for the ordinates. 

(b) Analyze the data and note any abnormalities. 

(c) As a supervisor, would you recommend reobservation of the 
station? 

2.13 The particular line in a survey is measured three times on four separate 
occasions. The resulting 12 observations in units of meters are 536.191, 
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536.189, 536.187, 536.202, 536.200, 536.203, 536.202,536.201, 536.199, 
536.196, 536.205, and 536.202. 

(a) Compute the mean, median, and mode of the data. 

(b) Compute the variance and standard deviation of the data. 

(c) Using a class width of 0.004 m, plot a histogram of the data, and 
note any abnormalities that may be present. 

2.14 Repeat Problem 2.13, but use a class width of 0.003 m in part (c). 

2.15 During a triangulation project, an observer made 32 readings for 
each direction using a 3" total station. The second’s portions of the 
directions are listed below. Using 7 class intervals, plot the histogram 
with relative frequencies for the ordinates. Analyze the data and state 
whether this set appears to be reasonable. 18, 17, 19, 13, 23, 18, 14, 18, 
22, 21, 22, 17, 17, 20, 20, 16, 24, 16, 17, 20, 21, 20, 22, 16, 26, 21, 17, 
21,25,24, 25, and 20. 

2.16 Two students have an argument over who can turn an angle better. 
To resolve the argument, they agree to each measure a single angle 
10 times. The results of the observations are: 


Student A 



Student B 



108°26'10". 

, 108°26'10", 

108°26'08", 

108°26T2", 

108°26'11", 

108°26'09", 

108°26'10". 

, 108°26'10", 

108°26'05", 

108°26'13", 

108°26'12", 

108°26'01", 

108°26'04". 

, 108°26'10", 

108°26'11", 

108°26'01", 

108°26'11", 

108°26'14", 

108°26'05" 



108°26'03" 




(a) What are the means and variances of both data sets? 

(b) Construct a histogram of each data set using a 3" class width. 

(c) Which student performed the best in this situation? 

Use the program STATS to do Problems 2.17-2.21. 

2.17 Use the program STATS to compute the mean, median, mode, and 
standard deviation of the data in Table 2.2 and plot a centered his¬ 
togram of the data using nine intervals. 

2.18 Problem 2.6. 

2.19 Problem 2.7. 

2.20 Problem 2.10. 

2.21 Problem 2.16. 
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2.22 Compute the standard deviation, root mean square error, and 
horizontal root mean square error for the map and check survey 
coordinates listed in the following table. 



Map Coordinates 

Check Survey 

Point 

e (m) 

n(m) 

h (m) 

E (m) 

N (m) 

H(m) 

1 

643,012.990 

382,012.235 

151.012 

643,012.978 

382,012.236 

151.029 

2 

643,018.605 

382,008.065 

145.000 

643,018.602 

382,008.045 

144.986 

3 

643,018.538 

382,001.677 

157.675 

643,018.525 

382,001.672 

157.676 

4 

643,027.819 

382,002.114 

152.290 

643,027.813 

382,002.111 

152.295 

5 

643,025.532 

382,007.696 

148.788 

643,025.534 

382,007.700 

148.776 

6 

643,033.905 

382,006.250 

150.051 

643,033.894 

382,006.239 

150.047 

7 

643,034.443 

382,002.517 

159.903 

643,034.430 

382,002.489 

159.916 

8 

643,028.021 

382,015.161 

154.465 

643,028.029 

382,015.162 

154.455 

9 

643,034.510 

382,010.184 

154.197 

643,034.501 

382,010.175 

154.200 

10 

643,034.510 

382,019.938 

150.347 

643,034.506 

382,019.951 

150.333 

11 

643,026.138 

382,022.895 

153.941 

643,026.142 

382,022.899 

153.959 

12 

643,020.959 

382,014.623 

151.639 

643,020.953 

382,014.629 

151.654 

13 

643,014.268 

382,022.626 

147.369 

643,014.250 

382,022.639 

147.359 

14 

643,011.308 

382,018.725 

153.243 

643,011.313 

382,018.714 

153.231 

15 

643,002.498 

382,020.575 

151.955 

643,002.502 

382,020.556 

151.954 

16 

643,003.137 

382,013.614 

155.297 

643,003.141 

382,013.629 

155.285 

17 

643,008.080 

382,009.344 

145.239 

643,008.076 

382,009.349 

145.241 

18 

643,002.532 

382,005.880 

153.661 

643,002.534 

382,005.885 

153.669 

19 

643,006.231 

382,002.988 

149.267 

643,006.240 

382,002.997 

149.270 

20 

643,002.061 

382,001.206 

150.317 

643,002.054 

382,001.211 

150.315 


PRACTICAL EXERCISES 

2.23 Using a total station, point and read horizontal circle to a well-defined 
target. With the tangent screw or jog-shuttle mechanism, move the 
instrument of the point and repoint on the same target. Record this 
reading. Repeat this process 50 times. Perform the calculations of 
Problem 2.6 using this data set. 
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OBSERVATIONS AND THEIR ANALYSIS 


2.24 Determine your EDM/reflector constant, K , by observing the distances 
between three points that are online, as shown in the figure. Dis¬ 
tance AB should be roughly 60 m long and BC roughly 90 m long 
with B situated at some location between A and C. From measured 
values AC, AB, and BC, the constant K can be determined as follows: 


Since 


AC + K = {AB + K) + (BC + K ) 


then 


K = AC - (AB + BC) 

When establishing the line, be sure that AB ± BC and that all three points 
are precisely on a straight line. Use three tripods and tribrachs to min¬ 
imize setup errors and be sure that all are in adjustment. Measure each 
line 20 times with the instrument in the metric mode. Be sure to adjust 
the distances for the appropriate temperature and pressure and for differ¬ 
ences in elevation. Determine the 20 values of K and analyze the sample 
set. What is the mean value for K, and what is its standard deviation? 



CHAPTER 3 


RANDOM ERROR THEORY 


3.1 INTRODUCTION 

As noted earlier, the adjustment of measured quantities containing random 
errors is a major concern to people involved in the geospatial sciences. In the 
remaining chapters, it is assumed that all systematic errors have been removed 
from the observed values and that only random error and blunders, which have 
escaped detection, remain. In this chapter the general theory of random errors 
is developed, and some simple methods that can be used to isolate blunders in 
sets of data are discussed. 


3.2 THEORY OF PROBABILITY 

Probability is the ratio of the number of times that an event should occur 
to the total number of possibilities. For example, the probability of tossing a 
two with a fair die is 1/6 since there are six total possibilities (faces on a die) 
and only one of these is a two. When an event can occur in m ways and fail 
to occur in n ways, then the probability of its occurrence is ml (in + n) and the 
probability of its failure is n/(m + n). 

Probability is always a fraction ranging between zero and 1. Zero denotes 
impossibility and one indicates certainty. Since an event must either occur or 
fail to occur, the sum of all probabilities for any event is 1, and thus if 1/6 is the 
probability of throwing a two with one throw of a die, then 1 - 1/6, or 5/6 is the 
probability that a two will not appear. 
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In probability terminology, a compound event is the simultaneous occurrence 
of two or more independent events. This is the situation encountered most fre¬ 
quently in surveying. For example, random errors from angles and distances 
(compound events) cause traverse misclosures. The probability of the simulta¬ 
neous occurrence of two independent events is the product of their individual 
probabilities. 

To illustrate this condition, consider the simple example of having two boxes 
containing combinations of red and white balls. Box A contains four balls, one 
red and three white. Box B contains five balls, two red and three white. What 
is the probability that two red balls would be drawn if one ball is drawn ran¬ 
domly from each box? The total number of possible pairs is 4 x 5, or 20, since 
by drawing one ball from box A, any of the five balls in box B would complete 
the pair. Now, there are only two ways to draw two red balls. That is, box A’s red 
ball can be matched with either red ball from box B. Therefore, the probability 
of obtaining two red balls simultaneously is 2/20. The probability of this com¬ 
pound event can be computed as the product of the individual probabilities of 
drawing a red ball from each box or 

P= 1/4x2/5 = 2/20. 

Similarly the probability of simultaneously drawing two white balls is 3/4 x 
3/5 or 9/20, and the probability of getting one red and one white is 1 - (2/20 + 
9/20) or 9/20. 

From the foregoing, it is seen that the probability of the simultaneous occur¬ 
rence of two independent events is the product of the individual probabilities 
of those two events. This principle is extended to include any number of events 

P = P l x P 2 x ■ ■ ■ x P n (3.1) 

where P is the probability of the simultaneous occurrence of events having indi¬ 
vidual probabilities P l , P 2 ,..., P n . 

To develop the principle of how random errors occur, consider a very simple 
example where a single tape measurement is taken between points A and B. 
Assume that this measurement contains a single random error of size 1. Since 
the error is random, there are two possibilities for the value of the resultant 
error, +1 or -1. Let t be the number of ways each resultant error can occur and 
Tbe the total number of possibilities, which is two. The probability of obtaining 
+ 1, which can occur only one way (i.e., t = 1), is tIT or 1/2. This is also the 
probability of obtaining -1. Suppose now that in measuring a distance AE, the 
tape must be placed end-to-end so that the result depends on the combination 
of two of these tape measurements. Then the possible error combinations in 
the result are -1 and -1, -1 and +1, +1 and -1, and +1 and +1, with T — 4. 
The final errors are -2, 0, and +2, and their t values are 1,2, and 1, respectively. 
This produces probabilities of 1/4,1/2, and 1/4, respectively. In general, as n, the 
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TABLE 3.1 Occurrence of Random Errors 


(1) 

Number of 
Combining 
Measurements 

(2) 

Value of 
Resulting 
Error 

(3) 

Frequency, t 

(4) 

Total Number 
of Possibilities, 

T 

(5) 

Probability 


+ 1 

1 


1/2 

1 

-1 

1 

2 

1/2 


+2 

1 


1/4 

2 

0 

2 

4 

1/2 


-2 

1 


1/4 


+3 

1 


1/8 


+ 1 

3 


3/8 

3 

-1 

3 

8 

3/8 


-3 

1 


1/8 


+4 

1 


1/16 


+2 

4 


1/4 

4 

0 

6 

16 

3/8 


-2 

4 


1/4 


-4 

1 


1/16 


+5 

1 


1/32 


+3 

5 


5/32 


+i 

10 


5/16 

5 

-i 

10 

32 

5/16 


-3 

5 


5/32 


-5 

1 


1/32 


number of single combined measurements, is increased, T increases according 
to the function T = 2”, and thus for three combined measurements, T = 2? — 8, 
and for four measurements, T=2 4 = 16. 

The analysis of the preceding paragraph can be continued to obtain the 
results shown in Table 3.1. Figure 3.1(a) through (e) are histogram plots of 
the results in Table 3.1 where the values of the resultant errors are plotted as 
the abscissas, and the probabilities are plotted as ordinates of equal-width bars. 


n =1 n =2 n =3 n=4 n =5 



(a) (b) (c) (d) (e) 


FIGURE 3.1 Plots of probability versus size of errors. 
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X 


FIGURE 3.2 Normal distribution curve. 


If the number of combining measurements, n, is increased progressively 
to larger values, the plot of error sizes versus probabilities would approach 
a smooth curve of the characteristic bell-shape shown in Figure 3.2. This 
curve is known as the normal error distribution curve. It is also called the 
probability density function of a normal random variable. Notice that when n is 
4, as illustrated in Figure 3.1 (d), and when n = 5, as shown in Figure 3.1(e), 
the dashed lines are already beginning to take on this form. 

It is important to notice that the total area of the vertical bars for each plot 
equals 1. This is true no matter the value of n, and thus, the area under the 
smooth normal error distribution curve is equal to 1. If an event has a probability 
of 1, it is certain to occur, and therefore the area under the curve represents the 
sum of all the probabilities of the occurrence of errors. 

As derived in Section D.l, the equation for the normal distribution curve, 
also called the normal probability density function, is 



(3.2) 


where f(x) is the probability density function, e the base of natural logarithms, 
x the error, and a is the standard error as defined in Chapter 2. 

3.3 PROPERTIES OF THE NORMAL DISTRIBUTION CURVE 

In Equation (3.2),/(x) is the probability of the occurrence of an error between 
x and x + dx, where dx is an infinitesimally small value. The error’s probability 
is equivalent to the area under the curve between the limits of x and x + dx, 
which is shown crosshatched in Figure 3.3. As stated previously, the total area 
under the probability curve represents the total probability, which is 1. This is 
represented in equation form as 



(3.3) 
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Let y represent/(.x) in Equation (3.2) and differentiate 


= 1 c .-x 2 /2a 2 \ 

dx ) 

Recognizing the term in parentheses of Equation (3.4) as y gives 

dy_ _ _x_ 
dx a 

Taking the second derivative of Equation (3.2), we obtain 

d 2 y _ _x_dy_ _ y_ 
dx 2 a 2 dx a 2 

Substituting Equation (3.5) into Equation (3.6) yields 

d 2 y _ _ y_ 

dx 2 a 4 ' ] a 2 

Equation (3.7) can be simplified to 

dry _ y (x 1 A 

dx 2 a 2 \(t 2 / 


(3.4) 


(3.5) 


(3.6) 


(3.7) 


(3.8) 


From calculus, the first derivative of a function gives the slope of the func¬ 
tion when evaluated at a point. In Equation (3.5), dy/dx = 0 when the values 
of x or y equal zero. This implies that the curve is parallel to the x axis at 
the center of the curve when x is zero and is asymptotic to the x axis as y 
approaches zero. 
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Also from calculus, a function’s second derivative provides the rate of change 
in a slope when evaluated at a point. The curve’s inflection points (points where 
the algebraic sign of the slope changes) can be located by finding where the 
function’s second derivative equals zero. In Equation (3.8), d 2 y/dx 2 = 0 when 
x 2 /a 2 -1=0, and thus the curve’s inflection point occurs when x equals ±a. 

Since e° = 1, if x is set equal to zero in Equation (3.2), then 


1 


(3.9) 



Equation (3.9) yields the curve’s central ordinate, and as can be seen, it is 
inversely proportional to a. According to Equation (3.9), a group of measure¬ 
ments having small a must have a large central ordinate. Thus, the area under 
the curve will be concentrated near the central ordinate, and the errors will be 
correspondingly small. This indicates that the set of measurements is precise. 
Since a bears this relationship to the precision, it is a numerical measure for 
the precision of a measurement set. In Section 2.7, we defined a as the standard 
error and gave equations for computing its value. 

3.4 STANDARD NORMAL DISTRIBUTION FUNCTION 

^3 In Section 3.2 we defined the probability density function of a normal 
random variable as fix) = 1 / \a s/2jr)e~ x2 / 2tj2 . From this, we develop the normal 
distribution function 



(3.10) 


where t is the upper bound of integration, as shown in Figure 3.4. 

As stated in Section 3.3, the area under the normal density curve repre¬ 
sents the probability of occurrence. Furthermore, integration of this function 
yields the area under the curve. Unfortunately, the integration called for in 
Equation (3.10) cannot be carried out in closed form, and thus numerical inte¬ 
gration techniques must be used to tabulate values for this function. This has 
been done for the function when the mean is zero = 0) and the variance is 1 
(a 2 = 1). The results of this integration are shown in the standard normal distri¬ 
bution table of Table D. 1. In this table, the leftmost column with a heading of 
t is the value shown in Figure 3.4 in the units of a. The top row, with headings 
0 through 9, represents the hundredths decimal places for the t values. The tab¬ 
ulated values in the body of the Table D. 1 represent areas under the standard 
normal distribution curve from -oo to t. For example, to determine the area 
under the curve from -oo to 1.68, first find the row with 1.6 in the t column. 
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FIGURE 3.4 Area under the normal distribution curve determined by 
Equation (3.10). 


Then scan along the row to the column with a heading of 8. At the intersection 
of row 1.6 and column 8 (1.68), the value 0.95352 occurs. This is the area under 
the standard normal distribution curve from -oo to a t value of 1.68. Similarly, 
other areas under the standard normal distribution curve can be found for var¬ 
ious values for t. Since the area under the curve represents probability, and its 
maximum area is 1, this means that there is a 95.352% (0.95352 x 100%) prob¬ 
ability that t is less than or equal to 1.68. Alternatively, it can be stated that 
there is a 4.648% (1 - 0.95352) x 100% probability that t is greater than 1.68. 

Once available. Table D.l can be used to evaluate the distribution function 
for any mean, /<, and variance, a 2 . For example, if y is a normal random vari¬ 
able with a mean of // and a variance of a 2 , an equivalent normal random 
variable z = (y - n)/o can be defined that has a mean of zero and a variance of 
1. Substituting the definition for z with /< = 0 and a 2 — 1 into Equation (3.2), 
its density function is 

N z (z) = ^— e - z2/2 (3.11) 

\2n 


and its distribution function, which is known as the standard normal distribution 
function , becomes 


Ak(z) 


= f J-e^dz 

j -OO 


( 3 . 12 ) 


For any group of normally distributed measurements, the probability of the 
normal random variable can be computed by analyzing the integration of the 
distribution function. Again, as stated previously, the area under the curve in 
Figure 3.4 represents probability. Let z be a normal random variable, then the 
probability that z is less than some value of t is given by 


P(z < t) = Nft) (3.13) 

To determine the area (probability) between t values of a and b (the 
crosshatched areas in Figures 3.5 and 3.6), the difference in the areas between 







46 RANDOM ERROR THEORY 



FIGURE 3.5 Area representing the probability in Equation (3.14). 


a and b, respectively, can be computed. By Equation (3.13), the area from 
-oo to b is P(z < b) = N,(b). By the same equation, the area from -oo to a 
is P(z < a) = N : (a). Thus the area between a and b is the difference in these 
values and is expressed as 

P(a < z < b) = N.(b) - N.(a) (3.14) 

If the bounds are equal in magnitude but opposite in sign, that is, -a = b = t, 
the probability is 

P{\z\<t) = N z {t)-N z {-t) (3.15) 

From the symmetry of the normal distribution in Figure 3.6, it is seen that 

P{z > t) = P(z < -t) (3.16) 

for any t > 0. Also, this symmetry can be seen with Table D. 1. The tabular value 
(area) for a t value of -1.00 is 0.15866. Furthermore, the tabular value for a t 
value of +1.00 is 0.84134. Since the maximum probability (area) is 1, the area 
above +1.00 is 1 - 0.84134, or 0.15866, which is the same as the area below 



FIGURE 3.6 Area representing the probability in Equation (3.16). 
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-1.00. Thus, since the total probability is always 1, we can define the following 
relationship 

1 - N z (t) = N z (-t) (3.17) 

Now substituting Equation (3.17) into Equation (3.15), we have 

P(\z\ < t) = 2N z (t) - 1 (3.18) 


3.5 PROBABILITY OF THE STANDARD ERROR 

The preceding equations can be used to determine the probability of the 
standard error, which from previous discussion is the area under the normal 
distribution curve between the limits of ±a. For the standard normal distri¬ 
bution when cr 2 is 1, it is necessary to locate the values of / = — l(cr = — 1) and 
f = +l(ff = l)in Table D.l. As seen previously, the appropriate value from the 
table for t = -1.00 is 0.15866. Also, the tabular value for t = 1.00 is 0.84134, 
and thus, according to Equation (3.15), the area between -a and H-c is 


P(—a < z < + 0 -) = N-i+a) - N-(—a) 

P(—o <z<+a) = 0.84134 - 0.15866 = 0.68268 

From this it has been determined that approximately 68.3% of all measure¬ 
ments from any data set are expected to he between -a and +<x. It also means 
that for any group of measurements there is approximately a 68.3% chance 
that any single observation has an error between ±a. The crosshatched area of 
Figure 3.7 illustrates that approximately 68.3% of the area exists between ±n. 
This is true for any set of measurements having normally distributed errors. 
Note that as discussed in Section 3.3, the inflection points of the normal dis¬ 
tribution curve occur at ±a. This is illustrated in Figure 3.7. 



FIGURE 3.7 Normal distribution curve. 







48 RANDOM ERROR THEORY 


3.5.1 The 50% Probable Error 

For any group of observations, the 50% probable error establishes the limits 
within which 50% of the errors should fall. In other words, any measurement 
has the same chance of coming within these limits as it has of falling outside 
them. Its value can be obtained by multiplying the observations’ standard devi¬ 
ation by the appropriate t value. Since the 50% probable error has a probability 
of one-half. Equation (3.18) is set equal to 0.50 and the t value corresponding 
to this area is determined as 


PCM < 0 = 0.5 = 2 N z (t) - 1 
1.5 = 2 N z (t) 

0.75 = N z (t) 

From Table D.l it is apparent that 0.75 is between a t value of 0.67 and 0.68; 
that is, 

IV.(0.67) = 0.7486 and Ah(0.68) = 0.7517 
The t value can be found by linear interpolation, as follows 


At _ 0.75 -0.7486 
0.68 -0.67 - 0.7517 -0.7486 
At = 0.01 x 0.4516 


0.0014 

0.0031 


0.4516 


and t = 0.67 + 0.0045 = 0.6745. Thus, the equation for linear interpolation can 
be expressed as 

NJt) - NJt x ) 

&19) 


where t is the desired t value, t x and t u the lower and upper t values that bound 
t, N.(t) the desired value from the table, and N z (t x ), and N z (t u ), the tabular 
values that bound N.(t). Thus, the previous example could be completed in 
one computation as 


/ = 0.67 + 


0.75 - 0.7486 
0.7517 - 0.7486 


(0.68 - 0.67) = 0.6745 


For any set of observations, therefore, the 50% probable error can be 
obtained by computing the standard error and then multiplying it by 
0.6745, or 

F 50 = 0.6745cr 


(3.20) 
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3.5.2 The 95% Probable Error 

The 95% probable error, or -^95 > is the bound within which, theoretically, 95% 
of the observation group’s errors should fall. This error category is popular 
with surveyors for expressing precision and checking for outliers in data. Using 
the same reasoning as in developing the equation for the 50% probable error, 
substituting into Equation (3.18), yields 

0.95 = P(\z\ <t) = 2N z (t) - 1 
1.95 = 2 N.(t) 

0.975 = N z (t) 

Again from the Table D.l, it is determined that 0.975 occurs with a t value 
of 1.960. Thus, to find the 95% probable error for any group of measurements, 
the following equation is used 


E 95 — 1.960(7 (3.21) 

3.5.3 Other Percent Probable Errors 

Using the same computation techniques as in Sections 3.5.1 and 3.5.2, other 
percent probable errors can be calculated. One other percent error worthy of 
particular note is ^ 99.7 • It is obtained by multiplying the standard error by 
2.968, or 

E 991 = 2.968(7 (3.22) 

This value is often used for detecting blunders, as discussed in Section 3.6. 
A summary of probable errors with varying percentages, together with their 
multipliers, is given in Table 3.2. 


TABLE 3.2 Multipliers for Various Percent Probable Errors 


Symbol 

Multiplier 

Percent Probable 
Errors 

E50 

0.6745(7 

50 

^90 

1.645(7 

90 

e 95 

1.960(7 

95 

e 99 

2.57(7 

99 

^ 99.7 

2.968(7 

99.7 

E99.9 

3.29(7 

99.9 
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3.6 USES FOR PERCENT ERRORS 

Standard errors and errors of other percent probabilities are commonly used 
to evaluate measurements for acceptance. Project specifications and contracts 
often require that acceptable errors be within specified limits such as the 90% 
and 95% errors. The 95% error, sometimes called the two-sigma (2<r) error 
because it is computed as approximately 2a, is most often specified. Standard 
error is also frequently used. The probable error, E 50 , is seldom employed. 

Higher-percentage errors are used to help isolate outliers (very large errors) 
and blunders in data sets. Since outliers seldom occur in a data set, measure¬ 
ments outside a selected high percentage range can be rejected as possible blun¬ 
ders. Generally, any data that differ from the mean by more than 3 a can be 
considered as blunders and removed from a data set. As seen in Table 3.2, reject¬ 
ing observations greater than 3<r means that about 99.7% of all observations 
should be retained. In other words, only about 0.3% of the observations in a 
set of normally distributed random errors (or 3 observations in 1000) should 
lie outside the range of ±3o\ 

Note that as explained in Chapter 2, standard error and standard devia¬ 
tion are often used interchangeably, when in practice, it is actually the standard 
deviation that is computed, not the standard error. Thus, for practical applica¬ 
tions, a in the equations of the preceding sections is replaced by S to distinguish 
between these two related values. 


3.7 PRACTICAL EXAMPLES 

Example 3.1 Suppose that the following values (in feet) were obtained in 
15 independent distance observations, Df. 212.22, 212.25, 212.23, 212.15, 
212.23, 212.11, 212.29, 212.34, 212.22, 212.24, 212.19, 212.25, 212.27, 212.20, 
and 212.25. Calculate the mean, S, E 50 , E 95 , and check for any observations 
outside the 99.7% probability level. 

SOLUTION From Equation (2.1), the mean is 


D — 


2 > 


3183.44 

15 


212.229 ft 


From Equation (2.10), S is 


'675, 576.955 - 15 x212.229 2 


15-1 


0.051298 


14 


= ±0.055 ft 
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where £Z) ( = 675,576.955. By scanning the data, it is seen that 10 observations 
are between 212.229 ± 0.055 or within the range of (212.174, 212.284). 1 This 
corresponds to 11/15 x 100, or 73.3% of the observations. For the set, this is 
what is expected if it conforms to normal error distribution theory. 

From Equation (3.20), E 50 is 

E 5 o = 0.67455 1 = ±0.6745(0.055) = ±0.037 ft 

Again by scanning the data, nine observations he between 212.229 ±0.037 ft. 
That is, they are within the range of (212.192, 212.266). This corresponds to 
9/15 X 100, or 60% of the observations. Although this should be 50%, and thus 
is a little high for a normal distribution, it must be remembered that this is only 
a sample of the population and should not be considered a reason to reject 
the entire data set. (In Chapter 4, statistical intervals involving sample sets are 
discussed.) 

From Equation (3.20), E 95 is 

E 95 = 1.9605 = ±1.960(0.055) = ±0.107 ft 

Note that 13 of the observations lie between 212.229 ± 0.107 (212.122, 
212.337) ft, or 87% of the data are within the range. 

At the 99.7% level of confidence, the range of ±2.9685 corresponds to an 
interval of ±0.163 ft. With this criterion for rejection of outliers, all values in 
the data are within this range. Thus, there is no reason to believe that any obser¬ 
vation is a blunder or outlier. 


Example 3.2 The second’s portions of 50 readings are listed below. Find the 
mean, standard deviation, and ^95 ■ Check the observations at a 99% level of 
certainty for blunders. 


41.9 

46.3 

44.6 

46.1 

42.5 

49.5 

45.5 

43.3 

42.6 

44.3 

43.0 

45.7 

47.6 

42.2 

44.3 

44.2 

46.3 

49.5 

46.0 

44.3 

43.4 

45.5 

43.1 

46.1 

43.6 


45.9 

45.0 

42.0 

47.5 

43.2 

46.1 

45.6 

52.0 

45.5 

43.4 

44.1 

42.6 

47.2 

47.4 

44.7 

42.8 

47.1 

44.7 

45.6 

45.5 

41.8 

44.7 

46.2 

43.2 

46.8 


SOLUTION The sum of the 50 observations is 2252, and thus the mean is 
2252/50 = 45.04". Using Equation (2.10), the standard deviation is 


/101,649.94- 50(45.04) 2 

V 50-1 


± 2 . 12 " 


'The expression of (x, y) represents a range between x and y. That is, about 68.3% of the data 
should lie between 212.16 and 212.28 in this example. 
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where ^y 2 = 101,649.94. There are 35 observations between 45.04" ±2.12", 
or within the range from 42.92" to 47.16". This corresponds to 35/50 x 100 or 
70% of the observations and correlates well with the anticipated level of 68.3%. 

From Equation (3.21), E 95 - ± 1.960(2.12") = ±4.16". The data actually con¬ 
tain three values that deviate from the mean by more than 4.16" (i.e., that are 
outside the range 40.88" to 49.20"). They are 49.5" (2) and 52.0". No values 
are less than 40.88", and therefore 47/50 x 100, or 94% of the observations lie 
in the E 95 range. 

From Equation (3.22), E 99 = ±2.576(2.12") = ±5.46", and thus, 99% of the 
data should fall between 45.04" ± 5.46", or (39.58", 50.50"). Actually, one 
value is greater than 50.50", and thus 98% of all the observations fall in this 
range. 

By the analysis above, it is seen that the data set is skewed to the left. That 
is, values higher than the range always fell on the right side of the data. The 
histogram shown in Figure 3.8 depicts this skewness. This suggests that it may 
be wise to reject the value of 52.0" as a mistake. The recomputed values for the 
data set (minus 52.0") are 

mean = (2252" - 52")/49 = 44.90" 

J^y 2 = 101,649.94 - 52.0 2 = 98,945.94 

„ /98,945.94 - 49(44.89795918) 2 . oc „ 

^ = V-49^1- = ±L88 



FIGURE 3.8 Skewed data set. 

Now after recomputing errors, 32 observations lie between ±S, which rep¬ 
resents 65.3% of the observations; 47 observations he in the E 95 range, which 
represents 95.9% of the data; and no values are outside the E 99 range. Thus, 
there is no reason to reject any additional data at the 99% level. 
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PROBLEMS 

Note: Partial answers to problems marked with an asterisk are given in 
Appendix H. 

* 3.1 Determine the t value for ^80 • 

3.2 Determine the t value for ^99.7 • 

3.3 Determine the t value for E 90 . 

3.4 Determine the t value for E 99 9 . 

3.5 Define probability. 

3.6 Define compound event. 

*3.7 If the mean of a population is 2.456 and its variance is 2.042, what is 
the peak value for the normal distribution curve, and the x coordinates 
for the points of inflection? 

3.8 If the mean of a population is 25.8 and its variance is 3.6, what is the 
peak value for the normal distribution curve, and the x coordinates for 
the points of inflection? 

3.9 If the mean of a population is 10.3 and its variance is 1.9, what is the 
peak value for the normal distribution curve, and the x coordinates for 
the points of inflection? 

3.10 Plot the curve in Problem 3.7 using Equation (3.2) to determine 
ordinate and abscissa values. 

3.11 Plot the curve in Problem 3.8 using Equation (3.2) to determine 
ordinate and abscissa values. 

3.12 Plot the curve in Problem 3.9 using Equation (3.2) to determine 
ordinate and abscissa values. 

3.13 The following data represent 21 electronically measured distance 
observations. 


485.62 

485.62 

485.63 

485.59 

485.66 

485.62 

485.61 

485.59 

485.62 

485.65 

485.64 

485.65 

485.61 

485.64 

485.62 

485.64 

485.64 

485.61 

485.68 

485.61 

485.63 


*(a) Calculate the mean and the standard deviation. 

(b) Plot the relative frequency histogram (of residuals) for the data 
above using a five class intervals. 

(c) Calculate the £50 and £90 intervals. 

(d) Can any observations be rejected at a 95% level of certainty? 

(e) What is the peak value for the normal distribution curve and 
where are the points of inflection on the curve on the x axis? 
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*3.14 Using the data in Problem 2.12, calculate the E 9i interval and identify 
any observations that can be rejected at a 95% level of certainty. 

3.15 Repeat Problem 3.14 for the data in Problem 2.15. 

3.16 Discuss the normality of each set of data below and whether any obser¬ 
vations may be removed at the 99% level of certainty as blunders or out¬ 
liers. Determine which set is more precise after apparent blunders and 
outliers are removed. Plot the relative frequency histogram to defend 
your decisions. 


Set 1: 









468.09 

468.13 

468.11 

468.13 

468.10 

468.13 

468.12 

468.09 

468.14 

468.10 

468.10 

468.12 

468.14 

468.16 

468.12 

468.10 

468.10 

468.11 

468.13 

468.12 

468.18 







Set 2: 









750.82 

750.86 

750.83 

750.88 

750.88 

750.86 

750.86 

750.85 

750.86 

750.86 

750.88 

750.84 

750.84 

750.88 

750.86 

750.87 

750.86 

750.83 

750.90 

750.84 

750.86 








3.17 Using the following data set, answer the questions below. 


46.5 

45.2 

48.4 

38.2 

54.7 

46.0 

38.5 

46.2 

53.4 

50.9 

53.7 

44.1 

45.1 

49.8 

49.7 

42.9 

56.7 

42.5 

43.6 

50.5 

48.5 

43.3 

46.2 

49.1 

45.4 

56.4 

48.2 

44.9 

47.8 

43.1 


(a) What are the mean and standard deviation of the data set? 

(b) Construct a relative frequency histogram of the data using seven 
intervals and discuss whether it appears to be a normal data set. 

(c) What is the E 95 interval for this data set? 

(d) Would there be any reason to question the validity of any observa¬ 
tion at the 95% level? 

3.18 Repeat Problem 3.17 using the following data: 

122.34 122.34 122.35 122.30 122.38 122.34 122.31 122.34 122.37 
122.36 122.37 122.33 122.34 122.36 122.36 122.33 122.38 122.33 
122.33 122.36 

3.19 What is the E 95 interval for the following data? Is there any reason to 
question the validity of any observation at the 95% level? 


8.6 8.5 8.9 7.4 9.6 8.6 7.7 8.6 9.4 9.1 

9.5 8.3 8.4 9.0 9.0 8.2 9.8 8.1 8.3 9.1 
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3.20 Using the data from Problem 3.19, what is the E 99 interval for the 
following data? Is there any reason to question the validity of any obser¬ 
vation at the 99% level? 

Use STATS to do Problems 3.21 and 3.22. 

3.21 Problem 3.16. 

3.22 Problem 3.17. 

PROGRAMMING PROBLEMS 

3.23 Create a spreadsheet to solve Problem 3.13. 

3.24 Create a computation package to solve Problem 3.19. 


CHAPTER 4 


CONFIDENCE INTERVALS 


4.1 INTRODUCTION 

Table 4.1 contains a discrete population of 100 values. The mean (n) and 
variance (a 2 ) of that population are 26.1 and 17.5, respectively. By randomly 
selecting 10 values from Table 4.1, an estimate for the mean and variance of 
the population can be determined. However, it should not be expected that 
these estimates (y and S 2 ) would exactly match the mean and variance of the 
population. Sample sets of 10-values each could continue to be selected from 
the population to determine additional estimates for the mean and variance 
of the population. However, it is just as unlikely that these additional values 
would match those obtained from either the population or the first sample set. 

As the sample size is increased, the mean and variance of the sample should 
approach the values of the population. In fact, as the sample size becomes very, 
very large, the mean and variance of the samples should be close to those of 
the population. This procedure was done for various sample sizes starting at 
10 values and increasing the sample by 10 values with the results shown in 
Table 4.2. Note that the value computed for the mean of the sample approaches 
the value of the population as the sample size is increased. Similarly, the value 
computed for the variance of the sample also tends to approach the value of 
the population as the sample size is increased. 

Since the mean of a sample set y and its variance S 2 are computed from ran¬ 
dom variables, they are also random variables. This means that even if the size 
of the sample is kept constant, varying values for the mean and variance can 
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TABLE 4.1 

Population of 100 Values 


18.2 

26.4 

20.1 

29.9 

29.8 

26.6 

26.2 

25.7 

25.2 

26.3 

26.7 

30.6 

22.6 

22.3 

30.0 

26.5 

28.1 

25.6 

20.3 

35.5 

22.9 

30.7 

32.2 

22.2 

29.2 

26.1 

26.8 

25.3 

24.3 

24.4 

29.0 

25.0 

29.9 

25.2 

20.8 

29.0 

21.9 

25.4 

27.3 

23.4 

38.2 

22.6 

28.0 

24.0 

19.4 

27.0 

32.0 

27.3 

15.3 

26.5 

31.5 

28.0 

22.4 

23.4 

21.2 

27.7 

27.1 

27.0 

25.2 

24.0 

24.5 

23.8 

28.2 

26.8 

27.7 

39.8 

19.8 

29.3 

28.5 

24.7 

22.0 

18.4 

26.4 

24.2 

29.9 

21.8 

36.0 

21.3 

28.8 

22.8 

28.5 

30.9 

19.1 

28.1 

30.3 

26.5 

26.9 

26.6 

28.2 

24.2 

25.5 

30.2 

18.9 

28.9 

27.6 

19.6 

27.9 

24.9 

21.3 

26.7 







TABLE 4.2 

Increasing Sample Sizes 

No. 

y 

S 2 

10 

26.9 

28.1 

20 

25.9 

21.9 

30 

25.9 

20.0 

40 

26.5 

18.6 

50 

26.6 

20.0 

60 

26.4 

17.6 

70 

26.3 

17.1 

80 

26.3 

18.4 

90 

26.3 

17.8 

100 

26.1 

17.5 


be estimated from the samples with greater confidence given to larger samples. 
Also, it can be concluded that the values computed from a sample also con¬ 
tain errors. To illustrate this, an experiment was run for four randomly selected 
sets of 10 values from Table 4.1. Table 4.3 lists these samples, their means, 
and variances. Notice the variation in the computed values for the four sets. 
As discussed above, this variation is expected. 


TABLE 4.3 Random Sample Sets from Population 


Set 1: 29.9, 18.2, 30.7, 24.4, 36.0, 25.6, 26.5, 29.9, 19.6, 27.9 y = 26.9 

Set 2: 26.9, 28.1, 29.2, 26.2, 30.0, 27.1, 26.5, 30.6, 28.5, 25.5 y = 27.9 

Set 3: 32.2, 22.2, 23.4, 27.9, 27.0, 28.9, 22.6, 27.7, 30.6, 26.9 y = 26.9 

Set 4: 24.2, 36.0, 18.2, 24.3, 24.0, 28.9, 28.8, 30.2, 28.1, 29.0 y = 27.2 


S 2 = 28.1 
S 2 = 2.9 
S 2 = 10.9 
S 2 = 23.0 
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Fluctuations in the computed means and variances from varying sample sets 
raises questions about the ability of these values to reliably estimate the popula¬ 
tion values. For example, a higher confidence is likely to be placed on a sample 
set with a small variance than on one with a large variance. Thus in Table 4.3, 
because of its small variance, one is more likely to believe that the mean of the 
second sample set is a more reliable estimate for the mean of the population 
than the others. In reality this is not the case since the means of the other three 
sets are actually closer to the population mean of 26.1. 

As noted earlier, the size of the sample should be also considered when 
determining the reliability of a computed mean or variance. If the mean were 
computed from a sample of five values and another computed from a sample 
of 30, then more confidence is likely to be placed on the values derived from 
the larger sample set than the smaller one, even if both sample sets have the 
same mean and standard deviation. 

In statistics, this relationship between the sample sets, the number of sam¬ 
ples, and the values computed for the means and variances is part of sampling 
distribution theory. This theory recognizes that estimates for the mean and 
variance do vary from sample to sample. Estimators are the functions used to 
compute these estimates. Examples of estimator functions are Equations (2.1) 
and (2.5) that are used to compute estimates of the mean and variance for 
a population, respectively. As demonstrated and discussed, these estimates 
vary from sample to sample and thus have their own population distributions. 
In Section 4.2, three distributions are defined that are used for describing or 
quantifying the reliability of mean and variance estimates. By applying these 
distributions, statements can be written about the reliability of the computed 
estimates at any given level of confidence. In other words, a range called the 
confidence interval can be determined within which the population mean and 
population variance can be expected to fall for varying levels of probability. 


4.2 DISTRIBUTIONS USED IN SAMPLING THEORY 


4.2.1 x 2 Distribution 

The chi-squared distribution, symbolized as / 2 , compares the relationship 
between the population variance and the variance of a sample set based on the 
number of redundancies in the sample. It was first published by Karl Pearson 
in 1900. If a random sample of n observations, y l ,y 2 ,..., y„, is selected from a 
population that has a normal distribution with mean and variance a 2 , then 
by definition, the / 2 sampling distribution is 


X 


2 



(4.1) 


where v is the number of degrees of freedom in the sample, and the other terms 
are as defined previously. 
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A plot of the distribution is shown in Figure 4.1. The number of redundan¬ 
cies (degrees of freedom) in sample set statistics such as those for the mean or 
variance are v = n - 1. In later chapters, on least squares it will be shown that 
the number of redundancies is based on the number of independent obser¬ 
vations and unknown parameters. In the case of the mean, one observation 
is necessary to determine the mean, thus leaving n — 1 values as redundant 
observations. Table D.2 is a tabulation of x 2 distribution curves for various 
degrees of freedom from 1 to 120. To find the area under the upper tail of the 
curve (right side shown shaded in Figure 4.1) starting at some specific / 1 value 
and going to infinity (oo), intersect the row corresponding to the appropriate 
degrees of freedom, v, with the column corresponding to the desired area 
under the curve. For example, to find the specific / 2 value relating to 1% 
(a = 0.010) of the area under a curve having 10 degrees of freedom, intersect 
the row headed by 10 with the column headed by 0.010 and find a / 2 value of 
23.21. This means that 1% of the area under this curve lies in the upper tail of 
this curve between the values of 23.21 and oo. 

Due to the asymmetric nature of the distribution, the percentage points 1 (a) 
of the lower tail (left side of the curve) must be computed from those tabu¬ 
lated for the upper tail. A specific area under the left side (lower tail) of the 
curve starting at zero and going to some specific x 2 value is found by sub¬ 
tracting the tabulated a (right-side area) from 1. This can be done since Table 
D.2 lists a (areas) starting at the x 2 value and going to oo, and the total area 
under the curve is 1. For example, if there are 10 degrees of freedom and the 
X 2 value relating to 1% of the area under the left side of the curve is needed, 
the row corresponding to v equal to 10 is intersected with the column headed 
by a = 0.990 (1 - 0.010), and a value of 2.56 is obtained. This means that 1% 
of the area under the curve occurs from 0 to 2.56. 

The x 2 distribution is used in sampling statistics to determine the range 
in which the variance of the population can be expected to occur based on 
(1) some specified percentage probability; (2) the variance of a sample set; 
and (3) the number degrees of freedom in the sample. In an example given in 
Section 4.6, this distribution is used to construct probability statements about 

1 Percentage points are decimal equivalents of percent probability; that is, a percent probability of 
95% is equivalent to 0.95 percentage points. 
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the variance of the population being in a range centered about the variance S 2 
of a sample having v degrees of freedom. In Section 5.3 a statistical test is pre¬ 
sented using the / 2 distribution to check if the variance of a sample is a valid 
estimate for the population variance. 

4.2.2 Student’s t Distribution 

The t distribution was developed in 1905 by William Seally Gosset, a chemist 
at Guinness brewery in Dublin, Ireland. At the time, he used the pseudonym 
of Student, and thus the distribution is sometimes called Student’s t distribu¬ 
tion. The distribution is used to compare a population mean with the mean 
of a sample set based on the number of redundancies (v) in the sample set. 
It is similar to the normal distribution (discussed in Chapter 3), except that the 
normal distribution applies to an entire population, whereas the t distribution 
applies to a sample set of the population. This distribution is preferred over the 
normal distribution when the sample contains fewer than 30 values. Thus, it is 
an important distribution in analyzing surveying data. 

If r is a standard normal random variable as defined in Section 3.4, / 2 is a 
chi-squared random variable with v degrees of freedom, and z and / 2 are both 
independent variables, then by definition 



The t values for selected upper-tail percentage points (shaded area in 
Figure 4.2) versus the t distributions with various degrees of freedom v are 
listed in Table D.3. For specific degrees of freedom (v) and percentage points 
(a), the table lists specific t values that correspond to the areas a under the 
curve between the tabulated t values and oo. Similar to the normal distribution, 
the t distribution is symmetric. Generally in statistics only percentage points 
in the range 0.0005 to 0.4 are necessary since the curve is symmetric. These 
t values are tabulated in Table D.3. To find the t value relating to a = 0.01 
for a curve developed with 10 degrees of freedom (v = 10), intersect the row 
corresponding to v = 10 with the row corresponding to a = 0.01. At this 
intersection the t value of 2.764 is obtained. This means that 1% (a = 0.01) of 
the area exists under the t distribution curve having 10 degrees of freedom in 
the interval between 2.764 and oo. Due to the symmetry of this curve, it can 
also be stated that 1% (a = 0.01) of the area under the curve developed for 
10 degrees of freedom also lies between -oo and -2.764. 

As described in Section 4.3, this distribution is used to construct confidence 
intervals for the population mean (/r) based on the mean ( y ) and variance (S 2 ) 
of a sample set and the degrees of freedom (v). An example in that section 
illustrates the procedure. Furthermore, in Section 5.3 it is shown that this 
distribution can be used to determine if the sample mean is a good estimate 
for the population mean. 
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4.2.3 F Distribution 


This distribution is used when comparing the computed variances from two 
sample sets. If x\ and x\ are two chi-squared random variables with iq and v 2 
degrees of freedom, respectively, and both variables are independent, then by 
definition 



(4.3) 


The distribution was first tabulated by George Snedecor as an aid for 
Ronald A. Fisher’s analysis of variance. Fisher developed the statistic initially 
as the variance ratio in the 1920s. 

Various percentage points (areas under the upper tail of the curve shown 
shaded in Figure 4.3) of the F distribution are tabulated in Table D.4. Notice 
that this distribution has v, numerator degrees of freedom and v 2 denominator 
degrees of freedom, which correspond to the two sample sets. Thus, unlike the 
X 1 and t distributions each desired a percentage point must be represented in 
a separate table. In Appendix D, tables for the more commonly used values of 
a (0.20, 0.10, 0.05, 0.025, 0.01, 0.005, and 0.001) are listed. 

To illustrate the use of the tables, suppose that the F value for 1% area under 
the upper tail of the curve is needed. Also assume that 5 is the numerator 
degrees of freedom relating to S l , and 10 is the denominator degrees of free¬ 
dom relating to S 2 . In this example, a equals 0.01 and thus the F table in Table 
D.4 that is written for a = 0.01 must be used. In that table, intersect the row 
headed by v 2 equal to 10 with the column headed by Vj equal to 5, and find the 
F value of 5.64. This means that 1% of the area under the curve constructed 
using these degrees of freedom lies in the region going from 5.64 to +oo. 

To determine the area in the lower tail of this distribution, use the following 
functional relationship. 


“.Vl.V 2 


1 


F\ 


—a,v 2 ,Vi 


(4.4) 


The critical F value for the data in the previous paragraph (v, equal to 5 and 
v 2 equal to 10) with a equal to 0.99 (0.01 in the lower tail) is determined by 
going to the intersection of the row headed by 5 with the column headed by 10 
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on the a equal to 0.01 page. The intersection is at F equal to 2.19. According 
to Equation (4.4) the critical F 099 5 j 0 is 1/E 0 0110 5 = 1/2.19 = 0.457. Thus, 1% 
of the area is under the F distribution curve going from zero to 0.457. 

The F distribution is used to answer the question on whether two sample sets 
come from the same population. For example, suppose that two samples have 
variances of .Sf and ,Sf. If these two sample variances represent the same pop¬ 
ulation variance, the ratio of their population variances (of/of) should equal 1 
(i.e., of = of). As discussed in Section 4.7, this distribution enables confidence 
intervals to be established for the ratio of the population variances. Also, as 
discussed in Section 5.4, the distribution can be used to test whether the ratio 
of the two variances is statistically equal to 1. 


4.3 CONFIDENCE INTERVAL FOR THE MEAN: T STATISTIC 

In Chapter 3, the standard normal distribution was used to predict the 
range in which the mean of a population may exist. This was based on the 
mean and standard deviation for a sample set. However, as noted previously, 
the normal distribution is based on an entire population, and as was demon¬ 
strated, variations from the normal distribution are expected from sample 
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sets having a small number of values. From this expectation, the t distribution 
was developed. As is demonstrated later in this section by an example, the t 
distribution (in Table D.3) for samples having an infinite number of values 
uses the same t values as those listed in Table 3.2 for the normal distribution. 
It is generally accepted that when the number of observations is greater than 
about 30, the values in Table 3.2 are valid for constructing intervals about 
the population mean. Flowever, when the sample set have less than 30 values, 
a t value from the t distribution should be used to construct the confidence 
interval for the population mean. 

To derive an expression for a confidence interval of the population 
mean, a sample mean (y) is computed from a sample set of a normally 
distributed population having a mean of and variance of the mean of a 1 In. 
Let z = (y - n)/{o / sfn) be a normal random variable. Substituting it and 
Equation (4.1) into Equation (4.2) yields 


(y-b)/Wv«) 0-b)/Wyn) y-n 


t = 


V x 2 h sJ{vS 2 /(j 2 )/v S/ G S/sJn 


To compute a confidence interval for the population mean (ji) given a sample 
set mean and variance, it is necessary to determine the area of a (1 - a) region. 
For example in a 95% confidence interval (unshaded area in Figure 4.4), center 
the percentage point of 0.95 on the t distribution. This leaves 0.025 in each of 
the upper- and lower-tail areas (shaded areas in Figure 4.4). The t value that 
locates an all area in both the upper and lower tails of the distribution is given 
in Table D.3 as t a/2 v . For sample sets having a mean of and variance of S 2 , the 
correct probability statement to locate this area is 


.P(|z| < t) = 1 - a 


(a) 


Substituting Equation (4.5) into Equation (a) yields 




FIGURE 4.4 t al2 plot. 
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which after rearranging yields 



(4.6) 


Thus, given y, t a/2 v , n, and S, it is seen from Equation (4.6) that a (1 - a) 
probable error interval for the population mean /< is computed as 



(4.7) 


where t a/2 is the critical t value from the t distribution based on v degrees of 
freedom and all percentage points. 

The following example illustrates the use of Equation (4.7) and Table D.3 for 
determining the 95% confidence interval for the population mean based on a 
sample set having a small number of values (n) with a mean of y and a variance 


of .S’. 


Example 4.1 In carrying out a control survey, 16 directional readings were 
observed for a single line. The mean (seconds portion only) of the readings 
was 25.4" with a standard deviation of ±1.3". Determine the 95% confidence 
interval for the population mean. Compare this with the interval determined 
by using a t value determined from the standard normal distribution tables 
(Table 3.2). 

SOLUTION In this example, the confidence level (1 - a) is 0.95, and thus 
a is 0.05. Since the interval is to be centered about the population mean p, a 
value of all in Table D.3 is used. This yields equal areas in both the lower and 
upper tails of the distribution as shown in Figure 4.4. Thus, for this example, 
all is 0.025. The appropriate t value for this percentage point with v equal to 
15(16- 1) degrees of freedom is found in Table D.3 as follows: 

Step 1: In the leftmost column of Table D.3, find the row with the cor¬ 
rect number of degrees of freedom (v) for the sample. In this case it is 
16 - 1, or 15. 

Step 2: Find the column headed by 0.025 for all. 

Step 3: Locate the intersection of this row and column, which is 2.131. This is 
the critical t value. 

Step 4: Then by Equation (4.7), the appropriate 95% confidence interval is 


24.7 = 25.4-2.131 


1.3 


— y - fi).025 —p < P < y + to 025 —— 

v« yn 


= 25.4 + 2.131 


y/l6 

1.3 



y/n 
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This computation can be written more compactly as 

j± Ws— or25.4 ±2.131 ( — ) =25.4 ±0.7 

Wl6/ 

After making the above calculation, it can be stated that for this sample, 
with 95% confidence, the population mean (/r) lies in the range (24.7, 26.1). 
If this was a large sample, the ^95 value from Table 3.2 could be used for 95%. 
That E 95 value is 1.960, and the standard error in the mean then would be 
±1 3/\f\6 = ±0.325. Thus, the population’s mean would be in the range 25.4 ± 
1.960(0.325"), or (24.8,26.0). Notice that due to the small sample size, the / dis¬ 
tribution gives a larger range for the population mean than does the standard 
normal distribution, which allows for error in the sample statistics. Notice also 
that in the / distribution of Table D.3, for a sample of infinite size (i.e., v = oo), 
the tabulated / value for a equal to 0.025 is 1.960, which matches Table 3.2. 

The / distribution is often used to isolate outliers or blunders in observations. 
To do this, a percent confidence interval is developed about the mean for a 
single observation as 

y-1„/2 s <y t <y + t a/2 s (4.8) 

Using the data from Example 4.1 and Equation (4.8), the 95% range for the 
16 directional readings is 

25.4" - 2.131(1.3") = 22.63" < y t < 28.17" = 25.4" + 2.131(1.3") 

Thus, 95% of the data should be in the range of (22.6", 28.2"). Any data values 
outside of this range can be considered as outliers and rejected with a 95% level 
of confidence. It is important to note that if the normal distribution value of 
1.960 was used to compute this interval, the range would be smaller at (22.85", 
27.95"). Using the normal distribution could result in discarding more observa¬ 
tions than is justified when using the sample estimates of the mean and variance. 
It is important to note that this will become more significant as the number of 
observations in the sample becomes smaller. For example, if only four direc¬ 
tional readings are obtained, then the /-distribution multiplier would become 
3.183. The resulting 95% confidence interval for a single observation would be 
1.6 times larger than that derived using normal distribution / value. 


4.4 TESTING THE VALIDITY OF THE CONFIDENCE INTERVAL 

A test that demonstrates the validity of the theory of the confidence interval is 
illustrated as follows. Using a computer and normal random number generat¬ 
ing software, 1000 sample data sets of 16 values each were collected randomly 
from a population with mean ^ = 25.4 and standard error a = ±1.3. Using 
a 95% confidence interval (a = 0.05) and Equation 4.7, the interval for the 
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population mean derived for each sample set was computed and compared with 
the actual population mean. If the theory is valid, the interval constructed is 
expected to contain the population’s mean 95% of the time based on the confi¬ 
dence level of 0.05. Appendix E shows the 95% intervals computed for the 1000 
samples. The intervals not containing the population mean of 25.4 are marked 
with an asterisk. From the data tabulated, it is seen that 50 of 1000 sample sets 
failed to contain the population mean. This corresponds to exactly 5% of the 
samples. In other words, the proportion of samples that enclose the mean is 
exactly 95%. This demonstrates that the bounds calculated by Equation (4.7), 
in fact, enclose the population mean at the confidence level selected. 


4.5 SELECTING A SAMPLE SIZE 

A common problem encountered in surveying practice is to determine the 
necessary number of repeated observations to meet a specific precision. 
In practice, the size of S cannot be controlled absolutely. Rather, as seen in 
Equation (4.7), the confidence interval can be controlled only by varying the 
number of repeated observations. In general, the larger the sample size, the 
smaller the confidence interval. From Equation (4.7), the range in which 
the population mean (n) resides at a selected level of confidence (a) is 



(b) 


Now let / represent one-half of the interval in which the population mean 
lies. Then from Equation (b), I is 



Rearranging Equation (4.9) 



(4.10) 


In Equation (4.10), n is the number of repeated measurements, / the desired 
confidence interval, t a/2 the t value based on the number of degrees of freedom 
(v), and S the sample set standard deviation. In the practical application 
of Equation (4.10), t a/2 and S are unknown since the data set has yet to be 
collected. Also, the number of observations, and thus the number of redundan¬ 
cies, is unknown, since they are the computational objectives in this problem. 
Therefore, Equation (4.10) must be modified to use the standard normal 
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random variable, z, and its critical value of E, which is not dependent on 
v or n\ that is 



(4.11) 


where n is the number of repetitions, t a/2 the E value determined from the 
standard normal distribution table (Table D.l), <7 an estimated value for the 
standard error of the measurement, and / the desired confidence interval. 

Example 4.2 From the preanalysis of a horizontal control network, it is 
known that all angles must be measured to within ±2" at the 95% confidence 
level. Flow many repetitions will be needed if the standard deviation for a 
single angle observation has been determined to be ± 2 . 6 "? 

SOLUTION In this problem, a final 95% confidence interval of ±2" is 
desired. From previous experience or analysis , 2 the standard error for a single 
angle observation is estimated as ±2.6". From Table 3.2, the multiplier, (or 
E value) for a 95% confidence level is found to be 1.960. Substituting this into 
Equation (4.11) yields 



Thus, eight repetitions are selected since this is the closest even number above 
6.49. [Note that it is necessary to select an even number of repetitions because 
an equal number of face-left (direct) and face-right (reverse) readings must 
be taken to eliminate instrumental (systematic) errors.] 


4.6 CONFIDENCE INTERVAL FOR A POPULATION VARIANCE 

From Equation (4.1), / 2 = vS 2 /a 2 , and thus confidence intervals for the 
variance of the population, tr 2 , are based on the x 2 statistic, sample variance, 
and its degrees of freedom. Percentage points (areas) for the upper and lower 
tails of the x 2 distribution are tabulated in Table D.2. This table lists values 
(denoted by xl) that determine the upper boundary for areas from xl to ±co 
of the distribution, such that 


P(X 2 > xl) = « 


for a given number of redundancies, v. Unlike the normal distribution and 
the t distribution, the / 2 distribution is not symmetric about zero. To locate 
an area in the lower tail of the distribution, the appropriate value of x\_ a 


2 See Chapter 6 for procedures used to estimate the variances in angle observations. 
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must be found, where P(x 2 > x] ) = 1 - a. These facts are used to construct 
a probability statement for / 2 as: 


A/L /2 < T 2 < X 2 a/2 ) = 1 - “ ( 4 - 12 ) 

where x\- a p and x\p are tabulated in Table D.2 by the number of redundant 
observations. Substituting Equation (4.1) into Equation (4.12) yields 


P 



< 


vS 2 


< X 



= P 


X 


2 

l-a/2 


vS 2 


< 


< 



(4.13) 


Recalling a property of mathematical inequalities, that in taking the recip¬ 
rocal of a function the inequality is reversed, it follows that 


vS 2 


<a < 


vS 2 


X 


a/2 


Xl-a/2, 


1 — a 


(4.14) 


Thus, the (1 - a) confidence interval for the population variance (<r 2 ) is 


vS 2 


< a 2 < 


vS 2 


X 


a/2 


X 


(4.15) 


l-a/2 


Example 4.3 An observer’s pointing and reading error is estimated by 
collecting 20 readings while pointing at a distant, well-defined target. The sam¬ 
ple standard deviation for the operator is determined to be ±1.8". What is the 
95% confidence interval for n 2 ? 


SOLUTION For this example, the desired area enclosed by the confidence 
interval (1 - a) is 0.95. Thus a is 0.05, which is divided into the lower and 
upper tails of the distribution, and all equals 0.025. The tabulated values of 
xl 0 i 5 an d To 975 with v equal to 19 degrees of freedom are needed. They are 
found in the table (Table D.2) as follows: 


Step 1: Find the row with 19 degrees of freedom and intersect it with the 
column headed by 0.975. The critical value at the intersection is 8.91. 

Step 2: Follow this procedure for 19 degrees of freedom and 0.025. The crit¬ 
ical value is 32.85. Using Equation (4.15), the 95% confidence interval 
for (j 2 is 

(20 — 1 ) 1 . 8 2 _ _ 2 _ ( 20 - 1 ) 1 . 8 2 
32785 < ^ < 8791 

1.87 < a 2 < 6.91 


Thus, the population’s variance should lie between 1.87 and 6.91 95% of 
the time. 











70 CONFIDENCE INTERVALS 


The x 1 distribution is often used to see if the reference variance from a least 
squares adjustment is statistically equal to one. As you will learn in Chapters 5 
and 16, a two-tailed statistical test, which is equivalent to this confidence, is 
often used. This test is known as the goodness of fit test. However, some soft¬ 
ware packages simply list the reference variance and the range of the confidence 
interval provided by Equation (4.15) at a user-specified confidence level. The 
user must then check to see if the reference variance computed from the adjust¬ 
ment is in the confidence interval provided. 

4.7 CONFIDENCE INTERVAL FOR THE RATIO 
OF TWO POPULATION VARIANCES 

Another common statistical procedure used is to compare the ratio of two 
population variances. The sampling distribution of the ratio of is 

well known when samples are collected randomly from a normal popula¬ 
tion. The confidence interval for is based on the F distribution using 

Equation (4.3) as 



x\hi 


Substituting Equation (4.1) and reducing yields 



(4.16) 


To establish a confidence interval for the ratio, the lower and upper values 
corresponding to the tails of the distribution must be found. A probability 
statement to find the confidence interval for the ratio is constructed as follows. 



Rearranging yields 





(4.17) 
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where F t = F x _ a / 2 _ v and.F„ = F a / 2 , Vl ,v 2 - Substituting Equation (4.4) into (4.17) 

yields 



(4.18) 


Thus from Equation (4.18), the (1 - a) conhdence interval for the a\ 1 /a] 


ratio is 


a/2,v 1 ,v 2 


< ~2 < 
°2 


(4.19) 


Notice that the degrees of freedom for the upper and lower limits in 
Equation (4.19) are opposite each other, and thus v 2 is the numerator degrees 
of freedom and v, is the denominator degrees of freedom in the upper limit. 

An important situation where Equation (4.19) can be applied occurs in the 
analysis and adjustment of horizontal control surveys. During least squares 
adjustments of these types of surveys, control stations fix the data in space 
both positionally and rotationally. When observations tie into more than a 
minimal amount of control stations, the control coordinates must be mutually 
consistent. If they are not, any attempt to adjust the observations to the 
control will warp the data to fit the discrepancies in the control. A method for 
isolating control stations that are not consistent is to hrst do a least squares 
adjustment using only enough control to fix the data both positionally and 
rotationally in space. This is known as a minimally constrained adjustment, 
which is sometimes called a free adjustment. In traverse surveys, this means 
that one station must have fixed coordinates and one line must be fixed in 
direction. This adjustment is then followed with an adjustment using all 
available control. If the control information is consistent, the reference vari¬ 
ance (Sj) from the minimally constrained adjustment should be statistically 
equivalent to the reference variance (S~) obtained when using all control 
information (a constrained adjustment). That is, the ratio of Sj/S~ should 
be equal to 1. 


Example 4.4 Assume that a minimally constrained trilateration network 
adjustment has 24 degrees of freedom and a reference variance of 0.49. 
A constrained network adjustment of the same data has 30 degrees of freedom 
with a reference variance of 2.25. What is the 95% (1 - a) confidence interval 
for the ratio of the variances, and does this interval contain the numerical 
value of 1? Stated in another way, is there reason to be concerned about the 
control having values that are not consistent with the observational data? 
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SOLUTION In this example, the objective is to determine whether the two 
reference variances are statistically equal. To solve the problem, let the variance 
in the numerator be 2.25 and in the denominator be 0.49. Thus, the numerator 
has 30 degrees of freedom (tq = 30) and corresponds to the adjustment using 
all the control. The denominator has 24 degrees of freedom (v 2 = 24) and cor¬ 
responds to the minimally constrained adjustment. 3 With a equal to 0.05 and 
using Equation (4.19), the 95% confidence interval for this ratio is 



Note from the calculations above that 95% of the time, the ratio of the popula¬ 
tion variances is in the range 2.08 to 9.83. Since this interval does not contain 1, 
it can be stated that o~/o~ # 1, or oy a;, at a 95% level of confidence. Recall¬ 
ing from Equation (2.4) that the size of the variance is dependent on the size 
of the errors, it can be stated that the constrained adjustment revealed dis¬ 
crepancies between the observations and the control. This could be caused 
by inconsistencies in the coordinates of the control stations or by the pres¬ 
ence of uncorrected systematic errors in the observations. An example of an 
uncorrected systematic error is the failure to reduce distance observations to 
the mapping projection surface. Appendix F discusses the proper procedures 
used in reducing observations to a map projection surface. 


4.8 SOFTWARE 

The tables in Appendix D are limiting in relationship to the number of 
degrees of freedom and percentage points. These limitations can often be 
overcome with software. For example, the t distribution does not contain 
the required column for determining a 99.7% confidence interval or a row 
for 43 degrees of freedom. STATS, which is available on the companion 
website for this book, is capable of determining the critical t value for this 
interval. To do this using STATS, select the t distribution option from 
the statistics menu as shown in Figure 4.5. The software will request the 
necessary information from the user as shown in Figure 4.6, and return 
the critical t value as shown in Figure 4.7. Similar procedures can be used 
to determine the critical values for the / 2 and F distributions. STATS can 
also compute confidence intervals at selected probability levels. Figure 4.8 
shows the entry screen for Example 4.1. As can be seen the sample mean, 
standard deviation, number of observations, and confidence level are entered. 
Notice that the confidence level is entered as a percentage. In this example, 

3 For confidence intervals, it is not important which variance is selected as the numerator. In this 
case, the larger variance was selected arbitrarily as the numerator to match statistical testing meth¬ 
ods discussed in Chapter 5. 
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Window Help 


J. Histogram data _ 

Q Normal distribution 

Confidence Intervals > >d Chi-squared distribution 

Hypothesis tests ► ' 

F F distribution 
tau distribution 




FIGURE 4.5 Selecting the t distribution from the ADJUST statistics menu. 



FIGURE 4.6 Entering the upper-tail percentage points and degrees of freedom for 
the f-distribution critical value. 



FIGURE 4.7 Computed critical value from a t distribution for a 99.7% confidence 
interval with 43 degrees of freedom. 



FIGURE 4.8 Entry of data from Example 4.1 into STATS to compute a confidence 
interval. 
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FIGURE 4.9 Confidence interval computed from STATS for Example 4.1. 


95 is entered for the confidence level. Upon selecting the OK button, the 
software displays the computed confidence interval as shown in Figure 4.9. 
Similarly, confidence intervals for observations, the population variance, and 
the ratio of two population variances can be computed using STATS. 

Spreadsheets can also be used to determine the critical values for distri¬ 
butions. For example in Microsoft Excel®, the function tinvfa, degrees of 
freedom) can be used to determine the critical t value. Flowever, this function 
requires the overall percentage points from +oo to be entered. Thus, to find the 
critical t value for a 99.7% confidence interval with 43 degrees of freedom, the 
appropriate expression would be tinv( 0.003, 43) where 0.003 represents the 
sum of the lower- and upper-tail areas. In Excel®, the x 2 distribution function 
is chiinv( a, degrees of freedom). Flowever, this function requires the upper and 
lower percentage points for a , which is 0.0015 and 0.9985 for a 99.7% con¬ 
fidence interval. Finally, the F distribution critical values can be determined 
using the function Jinvfa, v,, v 2 ) where the function requires the appropriate 
percentage points for a, which is 0.0015 in this example, v, are the number 
of degrees of freedom for the numerator variance, and v 2 are the number of 
degrees of freedom for the denominator variance. These three functions can 
be used to reproduce the tables in Appendix D. 

Mathcad® can also be used to generate the various critical values not shown 
in the Appendix D tables. Chapter 4 of the e-book written for Mathcad® that 
accompanies this book demonstrates the use of these functions while recreating 
the examples presented in this chapter. Unlike the spreadsheet and the tables in 
this book, Mathcad® takes the probability and degrees of freedom for its input. 
For example, the critical value from the t distribution for a 99.7% confidence 
interval with 43 degrees of freedom is computed as t := <//(0.9985, 43), where 
0.9985 is determined from the area under the t distribution curve going from 
-oo to the upper-tail bounds; that is, it is 1 - a/2 where a is 0.003. Similarly, 
the x 2 critical values are computed by calling the function qchisqip, df) where 
p is the probability as defined previously and df are the number of degrees of 
freedom for the variance. F distribution critical values are determined by calling 
the function qF(p, df, df 2 ) where p is the probability as defined previously, df 
are the number of degrees of freedom for the numerator variance, and df are 
the number of degrees of freedom for the denominator variance. 
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PROBLEMS 

Note: Partial answers to problems marked with an asterisk are given in 
Appendix H. 

4.1 What is the estimator function for the population mean? 

4.2 Use the / 2 distribution table (Table D.2) to determine the critical values 
from the / 2 distribution that would be used to construct confidence 
intervals for a population variance for the following combinations: 
*(a) a = 0.10, v = 3 

(b) a = 0.05, v= 15 

(c) a = 0.01, v = 15 

(d) a = 0.05, v = 20 

4.3 Use the t distribution table (Table D.3) to determine the critical value 
from the t distribution that would be used to construct confidence inter¬ 
vals for a population mean for each of the following combinations: 
*(a) a = 0.10, v = 3 

(b) a = 0.01, v = 10 

(c) a = 0.05, v = 15 

(d) a = 0.01, v = 20 

4.4 Use the F distribution table (Table D.4) to determine the critical val¬ 
ues from the F distribution that would be used to construct confidence 
intervals for the ratio of two sample variances for each of the following 
combinations: 

*(a) a = 0.20, v x = 20, v 2 = 5 

(b) a = 0.10, Vj = 15, v 2 = 8 

(c) a = 0.05, V| = 30, v 2 = 10 

(d) a = 0.01, Vl = 10, v 2 = 20 

4.5 What is the computed x 2 value for the following conditions? 

*(a) v — 5, S~ — 1.23, and a 2 = 1.00 

(b) v = 8 , S ' 2 = 0.89, and a 2 = 1.00 

(c) v = 10, S 2 = 0.65, and a 1 — 1.00 

(d) v = 15, 5 2 = 1.56, and a 2 = 1.00 

4.6 A least squares adjustment is computed twice on a data set. When the 
data are minimally constrained with 10 degrees of freedom, a variance 
of 1.07 is obtained. In the second run, the constrained network has 
13 degrees of freedom with a variance of 1.56. The a priori estimate for 
the reference variances (population variances) in both adjustments are 
one; that is, <r 2 = a 2 — 1 . 
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(a) What is the 95% confidence interval for the reference variance in 
the minimally constrained adjustment? The population variance is 
one. Does this interval contain one? 

(b) What is the 95% confidence interval for the reference variance in 
the constrained adjustment? The population variance is one. Does 
this interval contain one? 

(c) What is the 95% confidence interval for the ratio of the two vari¬ 
ances? Is there reason to be concerned about the consistency of the 
control? Statistically justify your response. 

4.7 Repeat Problem 4.6 where the minimally constrained adjustment has 
20 degrees of freedom, a standard deviation of 0.65 is obtained, and 
the constrained adjustment has 24 degrees of freedom with a standard 
deviation of 2.02. Use a 99% confidence interval. 

4.8 The calibrated length of a baseline is 102.167 m. A properly 
reduced average distance of 102.162 m with a standard deviation of 
±0.0031 m is computed after the line is observed eight times with 
an EDM. 

*(a) What is the 95% confidence interval for the measurements? 

(b) At a 95% level of confidence, can you state that the EDM is work¬ 
ing properly? Statistically justify your response. 

4.9 Repeat Problem 4.8 using a calibrated baseline of 1200.001 m and an 
observed length of 1200.006 with a standard deviation of ±0.0038 m 
after the line is observed 10 times with an EDM. 

4.10 Repeat Problem 4.8 at 99%. 

4.11 Repeat Problem 4.9 at 99%. 

4.12 Develop a 95% confidence interval for the data in Problem 3.18, and 
determine if any observations may be rejected as outliers. 

4.13 Develop a 99% confidence interval for the data in Problem 3.19, and 
determine if any observations may be rejected as outliers. 

*4.14 An observer’s pointing and reading standard deviation is determined 
to be ±2.4" after pointing and reading the circles of a particular 
instrument 8 times (n = 8). What is the 99% confidence interval for the 
population variance? 

4.15 An observer’s pointing and reading standard deviation is determined 
to be ±2.2" after pointing and reading the circles of a particular 
instrument 8 times (n = 8). What is the 95% confidence interval for the 
population variance? 
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4.16 Repeat Problem 4.14 at 95%. 

4.17 Repeat Problem 4.15 at 99%. 

4.18 Was the observer in Problem 4.15 statistically better than the observer 
in Problem 4.14 at a 

*(a) 90% level of confidence? 

(b) 99% level of confidence? 

4.19 Using sample statistics and the data in Example 3.1, construct a 99% 
confidence interval: 

(a) For the data and identify any observations that may be outliers. 

(b) For the population variance. 

4.20 Using sample statistics and the data in Example 3.2, construct a 99% 
confidence interval: 

(a) For the data and identify any observations that may be outliers. 

(b) For the population variance. 

4.21 For the data in Problem 3.16, construct a 99% confidence interval for 
the ratio of the two variances for Set 1 and 2. Are the variances statis¬ 
tically equal at this level of confidence? Justify your response. 

4.22 Using sample statistics and the data from Problem 3.17, construct a 
95% confidence interval: 

(a) For the data and identify any observations that may be outliers. 

(b) For the mean. 

4.23 Using sample statistics (in feet) and the data from Problem 3.13, 
construct the appropriate 95% confidence interval and 

(a) Identify any observations that may be identified as possible outliers 
in the data. 

(b) If the length observed in Problem 3.13 was part of a calibration 
baseline with a published length of 485.603 ft, and the reported dis¬ 
tances were properly reduced to their ground marks, is the instru¬ 
ment working properly at a 95% level of confidence? 

(c) If the manufacturer specifications for this instrument indicate that 
a distance of this length should have a variance of 0.000025, is the 
precision of the instrument meeting the specifications at a 95% level 
of confidence? 

4.24 Use STATS to determine the critical values from the / 2 distribution 
that would be used to construct a 95% confidence interval for a popu¬ 
lation variance when there are 46 degrees of freedom. 
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4.25 Use STATS to determine the critical value from the t distribution that 
would be used to construct a 99.7% confidence interval for a population 
mean when there are 16 degrees of freedom. 

4.26 Use STATS to determine the critical values from the F distribution that 
would be used to construct a 99.7% confidence interval for the ratio of 
two sample variances when v x = 19 and v 2 = 23. 

4.27 Describe a method used to determine if the control station coordinates 
are inconsistent with the observations. 


CHAPTER 5 


STATISTICAL TESTING 


5.1 HYPOTHESIS TESTING 

In Example 4.4, we were not concerned about the actual bounds of the 
constructed interval, but rather, whether the constructed interval contained 
the expected ratio of the variances. This is often the case in statistics. That is, the 
actual values of the interval are not as important as is answering the question: 
Is the sample statistic consistent with what is expected from the population? 
The procedures used to test the validity of a statistic are known as hypothesis 
testing. The basic elements of a hypothesis test are as follows: 

1. The null hypothesis, H 0 , is a statement that compares a population 
statistic, which is usually derived from project specifications or spec¬ 
ifications for an instruments, with the population of a sample. This 
implies that the sample statistic is what is “expected” from the popu¬ 
lation. In Example 4.4, this would be that the ratio of the variances is 
statistically 1. 

2. The alternative hypothesis, H a , is what is accepted when a decision is made 
to reject the null hypothesis, and thus represents an alternative popula¬ 
tion of data from which the sample statistic was derived. In Example 4.4 
the alternative hypothesis would be that the ratio of the variances is not 
equal to 1, and thus the variance did not come from the same population 
of data. 

3. The test statistic is computed from the sample data and is the value 
used to determine whether the null hypothesis should be rejected. When 
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the null hypothesis is rejected, it can be said that the sample statistic 
computed is not consistent with what is expected from the population. 
In Example 4.4, a rejection of the null hypothesis would occur when the 
ratio of the variances is not statistically equivalent to 1. 

4. The rejection criterion is the expression for the test statistic where the 
null hypothesis is rejected. In reference to confidence intervals, this num¬ 
ber takes the place of the confidence interval bounds. That is, when the 
computed test statistic is greater than the rejection criterion defining the 
rejection region, it is equivalent to the sample statistic of the null hypoth¬ 
esis being outside the bounds of the confidence interval. That is, when 
the rejection criterion is true, the null hypothesis is rejected. 

5. The test decision is the practical results of the test. This is a statement 
about whether the observation or measurement statistically agrees with 
normal distribution theory. If the test fails to reject the null hypothesis, 
then there is no statistical reason to question the normality of the data. 
On the other hand, if the test rejects the null hypothesis, then there is a 
statistical reason to question the normality of the observations. 

Whenever a test decision is made concerning the null hypothesis, there is a 
possibility of making a wrong decision since there can never be 100% certainty 
about a statistic or a test. Returning to Example 4.4, a confidence interval of 
95% was constructed. With this interval, there is a 5% chance that the deci¬ 
sion is incorrect. That is, it is possible that the larger-than-expected ratio of 
the variances is consistent with the population of observations. This reasoning 
suggests that further analysis of statistical testing is needed. 

Two basic errors can occur when a decision is made about a statistic. A valid 
statistic could be rejected or an invalid statistic could be accepted. These two 
errors can be stated in terms of statistical testing elements as Type I and 
Type II errors. If the null hypothesis, H 0 , is rejected when in fact it is true, a 
Type I error is committed. If the null hypothesis is not rejected when in fact 
it is false, a Type II error occurs. Since these errors are not from the same 
population, the probability of committing each error is not directly related. 
A decision must be made as to the type of error that is more serious for the 
situation and thus based on the consequences of committing each error. For 
instance, if a contract calls for positional accuracies on 95% of the stations to 
be within ±0.3 ft, the surveyor is more inclined to commit a Type I error to 
ensure that the contract specifications are met. However, the same surveyor 
needing only 1 -ft accuracy on control to support a small-scale mapping project 
may be more inclined to commit a Type II error. In either case, it is important 
to compute the probabilities of committing both Type I and Type II errors 
to assess the reliability of the inferences derived from a hypothesis test. For 
emphasis, the two basic hypothesis-testing errors are repeated. 

• Type I Error: Rejecting the null hypothesis H 0 when it is in fact true 
(symbolized by a). 

• Type II Error: Not rejecting the null hypothesis H 0 when it is in fact false 
(symbolized by /?). 
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TABLE 5.1 Relationships in Statistical Testing 




Decision 

Situation 

Accept H 0 

Reject H 0 

H 0 true 

Correct decision: P = 1 

- a Type I error: P = a 


(confidence level) 

(significance level) 

H 0 false (H a true) 

Type II error: P = p 

Correct decision: P = 1 - /? 
(power of test) 



t 


Reject H a Reject H 0 

- Critical value - 


FIGURE 5.1 Graphical interpretation of Type I and Type II errors. 


Table 5.1 shows the relationship between the decision, the probabilities of a 
and /?, and the acceptance or rejection of the null hypothesis H 0 . In Figure 5.1 
the left distribution represents the data from which the null hypothesis is 
derived. That is, this distribution represents a true null hypothesis. Similarly, 
the distribution on the right represents the distribution of data for the true 
alternative. These two distributions could be attributed to measurements that 
contain only random errors (left distribution) versus measurements containing 
blunders (right distribution). In the figure, it is seen that valid measurements 
in the a region of the left distribution are being rejected at a significance level 
of a. Thus, a represents the probability of committing a Type I error. This is 
known as the significance level of the test. Furthermore, data from the right 
distribution are being accepted at a /? level of significance. The power of the 
test is 1 - p and corresponds to a true alternative hypothesis H a . Methods 
of computing /? or 1 — /? are not clear and are often difficult since nothing 
is generally known about the distribution of the alternative hypothesis. 
Consequently, in statistical testing, the objective is to prove the alternative 
hypothesis H a true by showing that the data does not support the statistic 
coming from the null hypothesis distribution. In doing this, only a Type I error 
can be made, for which a known probability of making a wrong decision is a. 

Example 5.1 As an example, assume that for a population of 10,000 people, 
a flu virus test has a 95% level of confidence and thus a significance level, a, of 
0.05. Suppose that 9200 people test negative for the flu virus and 800 test posi¬ 
tive. Of the 800 people who tested positive, 5% or 40 people will test incorrectly 









82 STATISTICAL TESTING 


(false-positive). That is, they will test positive for the flu but do not have it. This 
is an example of committing a Type I error at an a level of significance. Simi¬ 
larly assume that 460 people test negative for the flu when, in fact, they do have 
it (a false-negative case). This is an example of a Type II error at a probabil¬ 
ity of p that is equal to 0.046 (460/10,000). Furthermore, in this example, the 
power of the test is 1 - p, or 0.954. 


From the foregoing, it is seen that it is possible to set the probability of 
committing a Type I error for a given H 0 . However, for a fixed level of a and 
sample size n. the probability of a Type II error, p, is generally unknown. 
If the null hypothesis H 0 and a are fixed, the power of the test can only be 
increased by increasing the sample size, n. Since the power of the test may be 
low or unknown, statisticians always state that the test failed to reject the null 
hypothesis H 0 rather than making any statement about its acceptance. This is 
an important statistical concept. That is, it should never be stated that the null 
hypothesis H 0 is accepted since the power of the test is unknown. It should 
only be said that “there is no statistical evidence to reject the null hypothesis.” 
Because of this small but important distinction, it is important to construct a 
test that rejects the null hypothesis whenever it is possible. 

A similar situation exists with surveying measurements. If a distance mea¬ 
surement contains a large systematic error, it is possible to detect this with a 
fully constrained adjustment and thus reject the null hypothesis. However, if 
a distance contains a very small systematic error, the ability to detect the sys¬ 
tematic error may be low. Thus, while some confidence can be placed in the 
rejection of the null hypothesis, it can never be said that the null hypothesis H 0 
should be accepted since the probability of undetected small systematic errors 
or blunders cannot be determined. What we strive to do is minimize the size of 
these errors so that they have little effect on the computed results. 


5.2 SYSTEMATIC DEVELOPMENT OF A TEST 

When developing a statistical test, the statistician must determine the test 
variables and the type of test to perform. This chapter will look at statis¬ 
tical tests for the mean, variance, and ratio of two sample variances. The 
t test is used when comparing the sample mean of one population against 
another population mean. In surveying, the test often compares the mean 
of a sample set of observations against a known, calibration value. The 
X 1 test is used when comparing the sample variance of one population 
against another population variance. As discussed in Section 16.7, this 
test is used in a least squares adjustment when comparing the reference 
variance from an adjustment against its known population value. Finally, 
when comparing sample variances from two different populations, the F test 
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TABLE 5.2 Test Variables and Statistical Tests 


Variable 1, 

Test Statistic 

Variable 2, 

Sample Population 

Null Hypothesis 

Test Statistic 

Population mean, /< 0 

Mean, /< 

H = Mo 

t 

Population variance, a 2 

Variance, a 1 

ffj 

H 0 : a 2 = a 2 

X 2 

Ratio of sample variances 
equals 1 

4 

H„: 4 = 1 
ff 2 

F 


is used. As discussed in Section 21.7, this test is used in least squares adjust¬ 
ments when comparing the reference variances from a minimally constrained 
and overconstrained adjustment. Table 5.2 lists the test variables of these three 
statistical tests. 

A test can take two forms based on their distributions. The one-tailed test 
uses the critical value from either the left or right side of the distribution, 
whereas the two-tailed test is much like a confidence interval with critical values 
divided equally on both sides of the distribution. 

In the one-tailed test, the concern is whether the sample statistic is either 
greater or less than the statistic being tested. In the two-tailed test, the concern 
is whether the sample statistic is different from the statistic being tested. For 
example, when checking the angle reading capabilities of a total station against 
the manufacturer’s specifications, the surveyor would not be concerned if the 
instrument is working at a level better than the manufacturer’s stated accu¬ 
racy. However, the surveyor would probably send the instrument in for repairs 
if it was performing worse than the manufacturer’s stated accuracy. In this 
case, it would be appropriate to perform a one-tailed test. On the other hand, 
when checking the mean observed distance from an EDM against a known 
calibration baseline length, the surveyor wants to know if the mean length is 
statistically different from the calibration length. In this case it is appropriate 
to perform a two-tailed test. In the following sections, it is important to identify 
(1) the appropriate test statistic and (2) the type of test to perform. 

In all forms of statistical testing, a test statistic is developed from the 
data. The test statistic is then compared against a critical value from the 
distribution. If the rejection region statement is true, the null hypothesis H 0 is 
rejected at the selected level of significance. As stated earlier, this is the goal 
of a well-developed test since only the Type I error occurs at a known level of 
significance, which is a. If the rejection region statement is false, the test fails 
to reject null hypothesis H 0 . Because of the possibility of a Type II error, and 
due to the lack of knowledge about the alternative distribution, no statement 
about the validity of the null hypothesis can be made. At best, it can be stated 
that there is no reason to reject the null hypothesis H 0 . 





84 STATISTICAL TESTING 


5.3 TEST OF HYPOTHESIS FOR THE POPULATION MEAN 

At times, it may be desirable to test the population of a sample mean 
against a known value. The t distribution is used to build this test. The null 
hypothesis, H 0 , for this test can take two forms: one- or two-tailed tests. In 
the one-tailed test , the concern is whether the sample mean is either statisti¬ 
cally greater or less than the population mean. In the two-tailed test, the con¬ 
cern is whether the population of the sample mean, p 0 , is statistically different 
from another population mean, p\ this is equivalent to seeing if the population 
mean is in a confidence interval, as was done in Chapter 4. These two tests are 
shown below. 



One-Tailed Test 

Two-Tailed Test 

Null hypothesis: 

H 0 : p = p 0 

H 0 : p = p 0 

Alternative hypothesis: 

H a : P > P 0 (P < P 0 ) 

H a : p # p 0 

Test statistic 1 : 

t _y-i* o 

S/s/Ti 

(5.1) 

The region where the null 
hypothesis H 0 is rejected is 

t>t a (ort< t a ) 

\t\ > to/2 


It should be stated that for large samples (n > 30), the t value can be replaced 
by the standard normal variate, z. 

Example 5.2 A baseline of calibrated length 400.008 m is observed 20 times 
with an EDM instrument. The average of the 20 observed distances that 
are properly reduced 2 is 400.012 m with a standard deviation of ±0.002 m. 
Is the reduced distance different from the calibrated distance at a 0.05 level of 
significance? 

SOLUTION Assuming that proper field and office procedures were followed, 
the fundamental question is whether the EDM is working within its specifica¬ 
tions; that is, is the EDM providing distance observations in the population of 
calibrated values. To answer this question, a two-tailed test is used to determine 
whether the distance is either the same or different than the calibrated distance 
at a 0.05 level of significance. That is, the mean of the observed distances will 
be rejected if it is either statistically too short or too long to be considered the 
same as the calibration value. The rationale behind using a two-tailed test is 
similar to that used when constructing a confidence interval as in Example 4.1. 

'When performing a two-tailed test, you should take the absolute value of t. 

2 Observed distances must be reduced to the marks on the ground when using a calibration baseline. 
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That is, 2.5% of the area from the lower and upper tails of the t distribution is 
to be excluded from the interval constructed, or in this case, the test. 


Null hypothesis: 
Alternative hypothesis: 

By Equation (5.1), the test 
statistic is 

Rejection criterion: 


H 0 : fi = 400.012 
H a : 400.012 

y-li _ |400.012-400.008| 

S/^ 0.002/V20 

t = 8.944 > 2.093 = t a/2 


Since a two-tailed test is being performed, the all (0.025) column in the t 
distribution table is intersected with the 19-degrees of freedom row (v = n — 1). 
From the t distribution (Table D.3), ? 0 . 025.19 is found to be 2.093. Since the 
computed t of 8.944 is greater than the tabulated value of 2.093, the rejection 
criterion is satisfied. Since this rejection criterion is true, the null hypothesis H 0 
can be rejected at a 5% level of significance or 95% level of confidence. This 
implies that at least 5% of the time, the decision will be wrong or that a Type I 
error will occur. 

As stated earlier, a 95% confidence interval for the population mean could 
have been constructed also to derive the same results. Using Equation (4.7), 
that interval would be 

400.011 = 400.012 - 2.093 ( J < n < 400.012 + 2.093 

V V20 / 

= 400.013 

Note that this 95% confidence interval fails to contain the baseline value of 
400.008, and similarly, there is reason to be concerned about the calibration 
status of the instrument. That is, the EDM may not be working properly and 
should be retested or sent in for repair. 



5.4 TEST OF HYPOTHESIS FOR THE POPULATION VARIANCE 

In Example 5.2, the procedure for checking whether an observed length 
compares favorably with a calibrated value was discussed. The surveyor may 
also want to check if the instrument is measuring at its published precision. 
The x 2 distribution is used when comparing the variance of one population, 
a 2 against the variance from another population, a 2 . 

As shown in Table 5.2, the x 2 distribution checks the sample variance 
from one population against another population variance, which is typically a 
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FIGURE 5.2 Graphical interpretation of (a) one- and (b) two-tailed tests. 


specification of an instrument as reported by a manufacturer or a requirement 
for the survey to meet a certain accuracy. By using Equation (4.1), the 
following statistical test is written. 



One-Tailed Test 

Two-Tailed Test 

Null hypothesis: 

H 0 : g 2 = g 2 0 

H 0 : g 2 = g 1 - 

Alternative hypothesis: 

EI a : g 2 > a 2 (or 

H a : a 2 < a 2 ) 

H a : g 2 ^ a 2 

Test statistic: 

2 v ^ 2 

r= — 

G~ 

(5.2) 

Rejection region: The null 
hypothesis EI 0 is rejected 
when the rejection 
criterion is satisfied. 

X 2 > xl (or 

T 2 > XU 

T 2 < /L/2 or T 2 > xl /2 


Graphically, the null hypothesis H 0 is rejected in the one-tailed test when 
the computed x 2 value is greater than the tabulated value when the upper 
tail is being checked or when the / 2 value is less than the tabulated when 
the lower tail is being checked. The upper-tail rejection region is the shaded 
region shown in Figure 5.2(a). In the two-tailed test, the null hypothesis H 0 
is rejected when the computed value is either less than x\_ a p or greater than 
x\p- This is similar to the population variance being outside the confidence 
interval constructed from the sample variance using Equation (4.15). Again, 
in the two-tailed test, the probability selected is evenly divided between the 
upper and lower tails of the distribution such that the acceptance region is 
centered on the distribution. These rejection criteria are shown graphically in 
Figure 5.2(b). 
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Example 5.3 The owner of a surveying firm wants all surveying technicians 
to be able to read a particular instrument to within ±1.5". To test this value, 
the owner asks the senior field crew chief to perform a reading test with the 
instrument. The crew chief reads the circle 30 times and obtains a a x = ±0.9". 
Does this support the ±1.5" limit at a 5% level of significance? 

SOLUTION In this case, the owner wishes to test the null hypothesis that the 
a 2 equals 1.5 2 , against the alternative of a 2 being greater than 1.5 2 . That is, all 
standard deviations that are equal to or less than 1.5" will be accepted. Thus, 
a one-tailed test is constructed as follows (note that v = 30 - 1, or 29.) 


Null hypothesis: 
Alternative hypothesis: 


H 0 : a 2 = 1.5 2 


H a : a 2 > 1.5 

Test statistic from Equation (5.2): / 2 = 


2 (30 - 1)0.9 


1.5 2 


= 10.44 


The null hypothesis H 0 is rejected when the computed test statistic exceeds 
the tabulated critical value; that is, if the following statement is true. 

/ 2 = 10.44 > 42.56 = To. 05,29 

The value 42.56 comes from Table D.2 for / 2 Q5 , () . Since the computed 
X 2 value (10.44) is less than the tabulated critical value (42.56), the null 
hypothesis H 0 cannot be rejected. 

However, simply failing to reject the null hypothesis does not mean that 
the value of ±1.5" is valid. This example demonstrates a common problem 
in statistical testing when results are interpreted incorrectly. A valid sample 
set from the population of all surveying employees cannot be obtained by 
selecting only one employee. Furthermore, the test is flawed since every instru¬ 
ment reads differently and is in a different state of calibration. Additionally, 
new employees will have problems reading an instrument initially due to their 
lack of experience with the instrument. To account properly for this lack of 
experience, the employer could test a random sample of prospective employees 
during the interview process and again after several months of employment. 
The owner could then check for correlation between the company’s satisfaction 
with the employee and the employee’s initial ability to read the instrument. 
However, it is unlikely that any correlation would be found. This is an example 
of misusing statistics. 
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The previous example illustrates an important point to be made when using 
statistics. The interpretation of statistical testing requires judgment by the per¬ 
son performing the test. It should always be remembered that with a test, the 
objective is to reject and not accept the null hypothesis. Furthermore, a statis¬ 
tical test should only be used where appropriate. 

Example 5.4 The manufacturer specified accuracy for an EDM measuring 
a 1500-m distance is ±6 mm. A standard deviation of ±8 mm is obtained 
with this instrument from 10 observations of a 1500-m distance. Is this 
instrument repeating measurements within its specifications at a 1% level of 
significance? 

SOLUTION In this case, we want to test if a 2 equals 6 2 versus a 2 is greater 
than 6 2 . In this example, the question is being posed of whether or not the pop¬ 
ulation variance of the sample is statistically higher than the specified accuracy 
of the instrument from the manufacturer. Thus, a one-tailed test with a equal 
to 0.01 is performed as: 


Null hypothesis: 

Alternative hypothesis: 

Test statistic from Equation (5.2): 

Rejection region: The null hypothesis H 0 will 
be rejected if the computed x 2 value is 
greater than the tabulated value of / 2 m g or 
when the following statement is true: 


H 0 : a 2 = 6 2 
H a : a 2 > 6 2 


X 


X 


9(8 2 ) 


= 16 


16 >21.67 = 


X 


2 

0.01,9 


Since this statement is false, that is, 16 is not greater than 21.67, the null 
hypothesis H 0 cannot be rejected at a 1% level of significance. However, this 
does not mean that we can accept the fact that the instrument is repeating satis¬ 
factorily since we do not have any knowledge about the alternative distribution. 
Thus, we can simply state that due to this test, we see no reason at this time to 
question the repeatability of this instrument. That is, we see no reason to have 
the instrument repaired since we know nothing about the possible presence of 
a Type II error. 

Example 5.4 demonstrates the problem of a Type II error; that is, a negative 
result (failing to reject the null hypothesis) prevents one from accepting the 
null hypothesis H 0 as true. This problem is often overcome in statistical testing 
by repeated experiments. That is, in this example the same process could be 
repeated on different days at different times to introduce the variability of 
the environment into the test. If the test continues to fail to reject the null 
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hypothesis, then the instrument could be assumed to be working properly. 
In medical testing, a positive result on a test often means that the client has 
tested positive for some disease. To ensure that a Type I or Type II is not 
present, the test is often repeated several times to check if the same result 
are obtained. 


5.5 TEST OF HYPOTHESIS FOR THE RATIO 
OF TWO POPULATION VARIANCES 

Surveyors have generally considered control to be absolute and without 
error when adjusting data. However, it is a known fact that control, like any 
other quantities derived from observations, may contain error. As discussed 
in Section 4.7, one method of detecting for both the possible errors in control 
and the possible presence of systematic errors in a observations is to do both a 
minimally constrained and fully constrained least squares adjustment with the 
data. After doing both adjustments, the ratio of the post-adjustment reference 
variances can be compared. If the control is without error and no systematic 
errors are present in the data, the ratio of the two reference variances should 
be close to 1. Using Equation (4.18), a hypothesis test can be constructed to 
compare the ratio of two population variances using their two sample variances 
as follows: 



One-Tailed Test 

Two-Tailed Test 

Null hypothesis: 

, , 

H 0 : — = 1 (i.e., a; = cr-) 
ff 2 

H 0 : 

<y\ , 2 

— = 1 (i.e., a\ = ffj) 

ff 2 

Alternative 

hypothesis: 

2 

H a : -4 > 1 (i-e., a\ > <r?) 

or 

o\ , - 

H a : -4 < 1 (i-e„ of < a-) 
a 2 

H a : 

2 

~4 # 1 ^ ^ 

a 2 

Test statistic: 

c-2 o2 

F= oiF= -4 
*2 % 

F — 

larger sample variance 


smaller sample variance 

The null hypothesis should be rejected when the following statement 
is satisfied. 

F>F a F> F a/1 







90 STATISTICAL TESTING 


F a and F a/2 are critical values that locate the a and all areas, respectively, 
in the upper tail of the F distribution with v, numerator degrees of freedom 
and v 2 denominator degrees of freedom. Notice that in the two-tailed test, the 
degrees of freedom of the numerator are taken from the numerically larger 
sample variance and the degrees of freedom of the denominator are from the 
smaller variance. 

Example 5.5 Using the same data as presented in Example 4.4, would the null 
hypothesis be rejected? 

SOLUTION In this example, a two-tailed test is appropriate since the only 
concern is whether the two reference variances are statistically equal or not. 
The interval is centered on the F distribution with an all area in the lower 
and upper tails. In the analysis, the 30 degrees of freedom in the numerator 
corresponds to the larger sample variance, and the degrees of freedom in the 
denominator are 24, so that the following test is constructed: 

Null hypothesis: H 0 


Alternative hypothesis: H a 

Test statistic: F - 

Rejection of the null hypothesis occurs F = 4.59 > 2.21 = T 0 . 025 , 30,24 
when the following statement is true: 

Here it is seen that the computed F value (4.59) is greater than its tabulated 
critical value (2.21) from Table D.4 with v, equal to 30 and v 2 equal to 24. Thus, 
the null hypothesis H 0 can be rejected with a 5% chance of committing a Type I 
error. In other words, the fully constrained adjustment does not have the same 
variance as its minimally constrained counterpart at the selected 0.05 level of 
significance. Notice that the same result was obtained here as was obtained 
in Example 4.4 with the 95% confidence interval. Again, the network should 
be inspected for the presence of systematic errors, followed by an analysis of 
possible errors in the control stations. This post-adjustment analysis is revisited 
in greater detail in Chapters 20 and 25. 


3 = > 

-H 1 

ff 2 


2.25 

0.49 


= 4.59 


Example 5.6 Ron and Kathi continually debate who observes angles more 
precisely with a particular total station. Their supervisor, after hearing enough, 
describes a test where each is to measure a particular direction by pointing and 
reading the instrument 51 times. They must then compute the variance for their 
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data. At the end of the 51 readings, Kathi determines her variance to be 0.81, 
and Ron finds his to be 1.21. Is Kathi a better instrument operator at a 0.01 
level of significance? 


SOLUTION In this situation, even though Kathi’s variance implies that her 
observations come from a more precise population than Ron’s, a determina¬ 
tion must be made to see if the reference variances are statistically equal versus 
Kathi’s being better than Ron’s. This test requires a one-tailed F test with a 
significance level of a = 0.01. 


Null hypothesis: 


H 0 : 4 

°K 


1 (4 


4 ) 


Alternative hypothesis: 


Test statistic: 


o~ 


H a : -f >1 (4 > 4 ) 

<77 


F = 


K 

1.21 

0.81 


= 1.49 


The null hypothesis is rejected when the computed value for F (1.49) is 
greater than the tabulated critical value of T 0 01 50 50 (1.95) where Vj = v 2 = 50 
(51 - 1). Here it is seen that the computed value for F is less than its tabulated 
value, and thus, the test statistic does not satisfy the rejection region. That is, 
the rejection criterion is: 


F = 1.49 > 1.95 = F a 50 50 

Here the rejection criterion is false; that is, 1.49 < 1.95, and thus there is no 
statistical reason to believe that Kathi is better than Ron at a 0.01 level of 
significance. 


Example 5.7 A baseline is repeatedly observed using an EDM instrument 
over a period of time. Each day, 10 observations are taken and averaged. 
The variances for the observations are listed below. At a significance level of 
0.05, are the results of Day 2 significantly different from those of Day 5? 


Day 

1 

2 

3 

4 

5 

Variance, a 1 (mm 2 ) 

50.0 

61.0 

51.0 

53.0 

54.0 


SOLUTION This problem involves checking whether the variances of Day 2 
and Day 5 are statistically equal versus their being different. This is the same as 
constructing a confidence interval involving the ratio of the variances. Because 
the concern is about equality or inequality, this will require a two-tailed test. 
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Since there were 10 observations collected each day, both variances are based 
on 9 degrees of freedom (v’, and v 2 ). Assume that the variance for Day 2 is a; 
and the variance for Day 5 is it?. The test is constructed as follows: 


Null hypothesis: 


H 0 : 




Alternative hypothesis: 


EL 


" 2^1 ^ 2 * 


Test statistic: 


F=^- = 1.13 
54 


The null hypothesis is rejected when the computed F value (1.13) is greater 
than the tabulated critical value (4.03) in Table D.4. In this case the rejection 
criterion of F= 1.13 > 4.03 = F 0 025 9 9 is not satisfied; that is, 1.13 < 4.03. Con¬ 
sequently, the test fails to reject the null hypothesis H 0 and there is no statistical 
reason to believe that the data of Day 2 are statistically different from those 
of Day 5. 


5.6 SOFTWARE 

A new feature in STATS is its ability to perform hypothesis tests for the 
population mean, variance, and the ratio of two variances. This option, found 
in the statistics menu, provides a check on computations for the user of this 
book. Figure 5.3 shows the entry screen for the values from Example 5.2. 
Notice that the level of significance should be entered in percentage points and 
that the user can select that the test be performed in the lower tail or upper 
tail of the distribution, or perform the two-tail test, which was demonstrated 



FIGURE 5.3 Entry screen for performing the t test as shown in Example 5.2 in STATS. 
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FIGURE 5.4 Results for t test discussed in Example 5.2 in STATS. 


in Example 5.2. As shown in the figure, the user should simply enter the level 
of significance for the test. When entering the level of significance, users do 
not need to enter difference levels of significance for one-tailed and two-tailed 
tests. Thus, to perform the tests at a 95% level of confidence, a 0.05 level of 
significance is entered for both the one-tailed and two-tailed test. The results 
of the t test are shown in Figure 5.4. Notice that the software does not have 
access to the # symbol and thus chose to represent it as =/. The software can 
perform the / 2 and F test similarly. 


PROBLEMS 

Note: Answers to problems marked with * can be found in Appendix H. 

5.1 Why can the null hypothesis only be rejected in a statistical test? 

5.2 Explain why medical tests on patients are performed several times in a 
laboratory before the results of the test are returned to the doctor. 

5.3 Describe the difference between a Type I and Type II error. 

5.4 Describe the five elements of a hypothesis test. 

5.5 Describe the power of the test. 

5.6 Describe the similarities between a two-tailed hypothesis test and a con¬ 
fidence interval. 

5.7 In your own words, discuss when it is appropriate to use the 

(a) t test. 

(b) x~ test. 

(c) Ftest. 
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5.8 State whether the following examples should be one-tailed or two-tailed 
tests. 

*(a) Comparing a calibration baseline length against a value measured 
using an EDM. 

(b) Comparing the ability of a total station to repeat a measurement 
against the ISO standard. 

(c) Comparing the reference variance of a fully constrained adjust¬ 
ment against a minimally constrained adjustment. 

(d) The reference variance of a least squares adjustment against its a 
priori value of one. 

5.9 Compare the variances of day 2 and day 3 in Example 5.7 at a level of 
significance of 0.10 (a = 0.10). 

5.10 Compare the variances of day 1 and day 5 in Example 5.7 at a level 
significance of 0.05 (a = 0.05). 

5.11 Using the data given in Example 5.6, determine if Kathi is statistically 
better with the equipment than Ron at a significance level of: 

*(a) 0.01. 

(b) 0.10. 

5.12 The population reference variance from a properly weighted least 
squares adjustment is 1. After the running a minimally constrained 
adjustment having 15 degrees of freedom, the computed reference vari¬ 
ance is found to be 1.70. Is the computed reference variance statistically 
equal to 1 at a 

(a) 0.10 level of significance? 

(b) 0 .01 level of significance? 

5.13 When all the control is added to the adjustment in Problem 5.12, the 
reference variance for the fully constrained adjustment with 15 degrees 
of freedom is found to be 2.89. Are the reference variances from the 
minimally constrained and fully constrained adjustments statistically 
equal at a 

*(a) 0.10 level of significance? 

(b) 0 .01 level of significance? 

5.14 The calibrated length of a baseline is 402.267 m. After four observations 
with an EDM, a mean observation for the distance is 402.261 m with a 
standard deviation of ±0.0052 m. 

(a) Is the observed distance statistically different from the calibrated 
length at a 5% level of significance? 

(b) Is the observed distance statistically different from the calibrated 
length at a 1% level of significance? 
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5.15 A mean length of 1023.573 m with a standard deviation of ±0.0056 m is 
obtained for a distance after 10 observations. Using the technical spec¬ 
ifications, it is found that the standard deviation for this observation is 
estimated to be ±0.0043 m. 

(a) Perform a statistical test to check the repeatability of the instrument 
at a level of significance of 0.05. 

(b) Perform a statistical test to check the repeatability of the instrument 
at a level of significance of 0.10. 

5.16 A least squares adjustment is computed twice on a data set. When the 
data are minimally constrained with 20 degrees of freedom, a reference 
variance of 0.69 is obtained. In the second run, the fully constrained 
network also having 20 degrees of freedom has a reference variance of 

l. 89. The a priori estimate for the reference variance in both adjustments 
is 1; that is, erf = a; = 1. 

(a) Is the minimally constrained adjustment reference variance statisti¬ 
cally equal to 1 at a 0.05 level of significance? 

(b) Is the fully constrained adjustment reference variance statistically 
equal to 1 at a 0.05 level of significance? 

(c) Are the two variances statistically equal at a 0.05 level of 
significance? 

(d) Is there statistical reason to be concerned about the presence of 
errors in either the control or the observations? 

5.17 A total station with a manufacturer’s specified angular accuracy of ±3" 
was used the collect the data in Problem 3.17. Does the data warrant 
this accuracy at a 0.01 level of significance? Develop a statistical test to 
validate your response. 

5.18 An EDM is placed on a calibration baseline and the distance between 
two monuments is determined to be 1200.000 m ± 0.047 m after four 
observations. The calibrated length between the monuments is 1200.005 

m. Is the instrument measuring the length properly at a 

(a) 0.10 level of significance? 

(b) 0 .01 level of significance? 

5.19 Develop a hypothesis tests to answer Problem 4.6. 

5.20 Develop hypothesis tests to answer Problem 4.7. 

5.21 Develop a hypothesis test to answer Problem 4.8(b). 
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5.22 Develop a hypothesis test to answer Problem 4.9(b). 

5.23 Develop a hypothesis test to answer Problem 4.10(b). 

5.24 Develop a hypothesis test to answer Problem 4.11(b). 

5.25 Develop a hypothesis test to answer Problem 4.18(b). 

5.26 Develop hypothesis test to answer Problems 4.23(c) and 4.23(d). 


CHAPTER 6 


PROPAGATION OF RANDOM ERRORS 
IN INDIRECTLY MEASURED 
QUANTITIES 


6.1 BASIC ERROR PROPAGATION EQUATION 

As discussed in Section 1.2, unknown values are often determined 
indirectly by making direct measurements of other quantities that are func¬ 
tionally related to the desired unknown quantities. Examples in surveying 
include computing station coordinates from distance and angle observations, 
obtaining station elevations from rod readings in differential leveling, and 
determining the azimuth of a line from astronomical observations. As noted 
in Section 1.2, since all directly observed quantities contain errors, any values 
computed from them will also contain errors. This intrusion, or propagation, 
of errors that occurs in quantities computed from direct measurements is 
called error propagation. This topic is one of the most important discussed in 
this book. 

In this chapter, it is assumed that all systematic errors and mistakes have 
been eliminated from a set of direct observations, so that only random errors 
remain. To derive the basic error propagation equation, consider the simple 
function, z = a 1 x 1 + a 2 x 2 , where xq and x 2 are two independently observed 
quantities with standard errors oq and a 2 , and a x and a 2 are constants. 
By analyzing how errors propagate in this function, a general expression can 
be developed for the propagation of random errors through any function. 

Since x 1 and x 2 are two independently observed quantities, they each have 
different probability density functions. Let the errors in n determinations of vq 
be £j, e“, and the errors in n determinations of x 2 be e‘ 2 , e", e", then 
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z T , the true value of z for each independent observation, is 


z T — 


a x (xj - ) + a 2 (x!, — e l 2 ) = a x x\ + a 2 x‘ 2 - (a x e l x + a 2 £ 2 ) 

a x (x" — e") + a 2 (x“ - e l 2 ) = a x x “ + a 2 x" — + a 2 e ") 

' aj (xf - ef) + a 2 (xf - ef) = cqxf + a 2 xf - (a lE f + a 2 ef) 


( 6 . 1 ) 


The values for z computed from the observations are 

z ! = fljx'j + a 2 x!, 

z" = fljx" + u 2 x 2 (6.2) 

z iU = ajxf + a 2 xf 


Substituting Equations (6.2) into Equations (6.1) and regrouping 
Equations (6.1) to isolate the errors for each computed value yields 

z‘ — z T = a x £ l x + a 2 e\ 

z 11 — z T = a x £ x + a 2 e l 2 (6.3) 

z ia -z T = a x £f + a 2 £ 2 ‘ 


n 


From Equation (2.4) for the variance in a population, m 2 = ^ £ 2 , and thus 

i=i 

for the case under consideration, the sum of the squared errors for the value 
computed is 

n 

^ £ 2 = (fl|£| + a 2 £' 2 )~ + (ci x e" + a 2 £"Y + ( ci ]£ 7 j" + a 2 £ 2 ) 2 + • ■ ■ = no 2 (6.4) 

7=1 

Expanding the terms in Equation (6.4) yields 

nal = (flje'j ) 2 + 2fl 1 a 2 £j£2 + (a 2 £ 2 Y + { a i £ ")~ + 2 aia 2 e"e 2 + + ■ ■ ■ 

(6.5) 


Factoring terms in Equation (6.5) results in 

no 2 = a 2 ^£j 2 + ef + £ l f + • • • \ + a 2 (e 2 + ef + ef 2 + •••') 

+ 2a x a 2 (fjt!, + e"e“ + efef + • • •) (6.6) 

Inserting summation symbols for the error terms in Equation (6.6) yields 


n \ 


( n ^ 


(it 

Ed 

7=1 

+ 2 a x a 2 

Z £ l £ 2 

7=1 

+ a\ 

Z £ 2 

7=1 

n 

n 

\ ^ 

n 

\ 
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Recognizing that the terms in parentheses in Equation (6.7) are by definition: 
tr , and a* , respectively, Equation (6.7) can be rewritten as 

= a \°\ + ^a x a 2 ax lXl + a Wx 2 (6.8) 


In Equation (6.8) the middle term, o x x , is known as the covariance. This 
term shows the interdependence between the two unknown variables x x and 
x 2 . As the covariance term decreases, the interdependence of the variables also 
decreases. When these terms are zero, the variables are said to be mathematical 
independent. Its importance in surveying is discussed in more detail in later 
chapters. 

Equations (6.7) and (6.8) can be written in matrix form as 


£ 


a 


"2 _ 



Gy G y y 

*1 *1*2 


a \ 

2 

G x v O x 

L *1*2 *2 J 


a 2_ 


(6.9) 


where £ zz is the variance-covariance matrix for the function z. It follows logi¬ 
cally from this derivation that, in general, if z is a function of n independently 
measured quantities, x t , x 2 ,..., x n , then £ zz is 





1 

>< K> 

' 

1 


' a \ 

M 

II 

a 2 • 

• «;,] 

G Y Y 
*2*1 

G 1 

*2 

G Y V 
*2*71 


a 2 




a x n x x 

Gy y 
*n*2 

1 

CN vf 

b 


- a n_ 


( 6 . 10 ) 


Further for a set of m functions with n independently measured quantities, 
x x , x 2 ,-.., x n . Equation (6.10) expands to 


a u 

a n 

■ ■ ■ a \n 

a 2 \ 

a 22 

' ' ' a 2n 


ml 

^ m2 

®mn\ 

Gy y 
*71*1 

Gy v 
*2*71 

a U 

a 2\ 

a m\ 



a \2 

a 22 

a m2 



«1»« 

a 2n 

®mn_ 




C Y Y 

x l x n 


(7 Y Y 

x 2 x n 



( 6 . 11 ) 


Similarly, if the functions are nonlinear, a first order Taylor Series expan¬ 
sion can be used to linearize them. 1 Thus, a u , a l2 ,... are replaced by the par- 

1 Readers who are unfamiliar with solving nonlinear equations should refer to Appendix C of this 
book. 
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tial derivatives of the Z x , Z 2 ,... with respect to the unknown parameters, x h 
x 2 , ■ ■ ■ ■ Thus, after linearizing a set of nonlinear equations, the matrix for the 
function of Z can be written in linear form as 


E„ 


X 


dZj 

dZ x 

dZ x 

dx x 

dx 2 

dx„ 

dZ 2 

dZ 2 

dZ 2 

dx x 

dx 2 

dx n 

dZ m 

dZ m 

dZ m 

dx x 

dx 2 

dx n 

dZ x 

dZ 2 

dZ 

dx x 

dx x 

dx 

dZ x 

dZ 2 

dZ 

dx 2 

dx 2 

dx 

dZj 

dZ 2 

dZ, 

X 

dx n 

dx 


ol. 


<7 V v 

x l x 2 




x 2 


7 (7 

X„X X X-yX, 


(7 Y 

x 2 x n 


( 6 . 12 ) 


Equations (6.11) and (6.12) are known as the general law of propagation 
of variances (GLOPOV) for linear and nonlinear equations, respectively. Both 
Equations (6.11) and (6.12) can be written symbolically in matrix notation as 


X^ = AXA l 


(6.13) 


where E zz is the covariance matrix for the function Z. For a nonlinear set of 
equations that is linearized using Taylor’s Theorem, the coefficient matrix (A) 
is called a Jacobian matrix. That is, it is a matrix of partial derivatives with 
respect to the unknowns, as shown in Equation (6.12). 

If the observations, x x , x 2 , ■ ■ ■, x n , are unrelated, that is, they are statistically 
independent, then the covariance terms o x x , x ,... are equal to zero and the 
right side of Equations (6.10) and (6.11) can be rewritten, respectively, as 



a \\ 

a \2 

■ ■ ■ «1 n 


i 

Q 

g. fo 

0 • 

■ 0 ' 

S zz = 

a 2\ 

a 22 

■ ■ ■ a 2n 


0 

al 

x 2 

■ 0 


a m\ 

®m2 

®mn 


0 

0 • 











a u 

a 2\ ’ ’ ’ 

a m\ 

a 12 

a 22 ■ ■ ■ 

a m2 

a \n 

«2« • • • 

( 'nin 


(6.14) 
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= 


x 


dZj 

dZ j 

dZ x _ 

dx\ 

dx 2 

dx n 

dZ 2 

dZ 2 

dZ 2 

dx | 

dx 2 

dx n 

dZ m 

dZ m 

dZ m 

dx x 

dx 2 

dx n _ 

-1 

N 

dZ 2 

dZ„, 

dx x 

dx x 

dx l 

dZ] 

dZ 2 

dZ m 

dx 2 

dx 2 

dx 2 

dZ 1 

dZ 2 

dZ m 

R 

X 

_1 

dx n 

dx n 


r (T?. 


0 

a 1 

x 2 


0 0 


(6.15) 


If there is only one function Z, involving n unrelated quantities, vq, x 2 ,... 
k„, then Equation (6.15) can be rewritten in algebraic form as 



Equations (6.14), (6.15), and (6.16) express the special law of propagation of 
variances (SLOPOV). These equations govern the manner in which errors from 
statistically independent observations (i.e., a xx = 0) propagate in a function. 
In these equations, individual terms represent the individual contributions to 
the total error that occur as the result of observational errors for each inde¬ 
pendent variable. When the size of a function’s estimated error is too large, 
inspection of these individual terms will indicate the largest contributors to 
the error. The most efficient method to reduce the overall error in the func¬ 
tion is to closely examine ways to reduce the largest individual error terms in 
Equation (6.16). 


6.1.1 Generic Example 

Let A = B + C, and assume that B and C are independently observed quantities. 
Note that dA/dB = 1 and dA/dC = 1. Substituting these into Equation (6.16) 
yields 


a a = \/ (1^) 2 + ( lo c)” 


( 6 . 17 ) 
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Using Equation (6.15) yields 


*AA = [1 


1 ] 


a l 0 


1 

0 o 2 c 


1 




Equation (6.17) yields the same results as Equation (6.16) after the square root 
of the single element is determined. In the equations above, standard error (er) 
and standard deviation ( S) can be used interchangeably. 


6.2 FREQUENTLY ENCOUNTERED SPECIFIC FUNCTIONS 

6.2.1 Standard Deviation of a Sum 

Let A = + B 2 + • • • + B n , where the B s are n independently observed quan¬ 
tities having standard deviations of S B ,S B , then by Equation (6.16), 

S A = ^/Sl i+ Sl 2 + --- + Sl n (6.18) 

6.2.2 Standard Deviation in a Series 

Assume that the error for each observed value in Equation (6.18) is 
equal—that is, S B] = S Bi = ■ ■ ■ = S B „ = S B , then Equation (6.18) simplifies to 

S A = S B y/n (6.19) 

6.2.3 Standard Deviation of the Mean 

Let v be the mean obtained from n independently observed quantities y x , 
y n , each of which has the same standard deviation S. As given in 
Equation (2.1), the mean is expressed as 

y\ + yi h -f y n 

y = - 

n 

An equation for Sy, the standard deviation of the mean is obtained by sub¬ 
stituting the above expression into Equation (6.16). Since the partial derivatives 
of with respect to the observed quantities, y u y 2 ,..., y n , is dy/dy x = dy/dy 2 = 
• • • = dy/dy n = l/«, the resulting error in is 



Note that Equation (6.20) is the same as Equation (2.8). 
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6.3 NUMERICAL EXAMPLES 

Example 6.1 The dimensions of a rectangular tank shown in Figure 6.1 
are observed as 

L = 40.00 ft S L = ±0.05 ft 
W = 20.00 ft S w = ±0.03 ft 
H= 15.00 ft S H = ±0.02 ft 

Find the tank’s volume and the standard deviation in the volume using the 
observations above. 

SOLUTION The volume of the tank is found by the formula 

V = LWH = 40.00 (20.00) (15.00) = 12,000 ft 3 

Given that the standard deviation in the computed volume is determined by 
using Equation (6.16), which yields 



= yj (IFi/) 2 (0.05) 2 + (ZJT) 2 (0.03) 2 + (LIF) 2 (0.02) 2 

= y /(300 x 0.05) 2 + (600 x 0.03) 2 + (800 x 0.02) 2 
= V225 + 324 + 256 = V805 = ±28 ft 3 (a) 

In Equation (a), the second term is the largest contributor to the total error, 
and thus, to reduce the overall error in the computed volume, it would be pru¬ 
dent first to try to make S w smaller. This would yield the greatest effect in the 
error of the function. 


Example 6.2 As shown in Figure 6.2, the vertical angle a to point B is 
observed at point A as 3°00' with S a being ±F. The slope distance D from A 
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FIGURE 6.2 Horizontal distance from slope observations. 


to B is observed as 1000.00 ft with S D being ±0.05 ft. Compute the horizontal 
distance and its standard deviation. 

SOLUTION The horizontal distance is determined using the equation 

H = D cos (a) = 1000.00 cos (3°00') = 998.63 ft 

Given dH/dD = cos a and dH/da = —D sin a, the error in the function is 
determined by using Equation (6.16) as 



In Equation (6.21), S a must be converted to its equivalent radian value to 
achieve agreement in the units. Thus, 


S H - \\(cos a X 0.05) 2 + ( - sin a x D x 


60" 


206,264.8 /rat/ 


(0.9986 x 0.05) 2 + 1 °- 0523 x 1000 x 60 


206264.8" 
Vo. 04993 2 + 0.0152 2 = ±0.052 ft 


Notice in this example that the major contributing error source (largest num¬ 
ber under the radical) is 0.04993 2 . This is the error associated with the distance 
observation, and thus if the resulting error of ±0.052 ft is too large, the logical 
way to improve the results (reduce the overall error) is to adopt a more precise 
method of measuring the distance. 


Example 6.3 The elevation of a point C on a chimney shown in Figure 6.3 
is desired. Field angles and distances are observed. Station A has an elevation 
of 1298.65 ± 0.006 ft and Station B has an elevation of 1301.53 ± 0.004 ft. 
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C 



FIGURE 6.3 Elevation of chimney determined using intersecting angles. 


The instrument height, hi A , at Station A is 5.25 ± 0.005 ft and the instrument 
height, hi B , at Station B is 5.18 ± 0.005 ft. The other observations and their 
errors are 

AB = 136.45 ± 0.018 

A = 44°12'34" ± 8.6" B = 39°26'56" ± 11.3" 

V! = 8°12'47" ± 4.1" v 2 = 5°50T0" ± 5.1" 

What are the elevation of the chimney and the error in this computed value? 

SOLUTION Normally, this problem is worked in several steps. The steps 
include computing distances AI and BI and solving for the average elevation of 
C using observations obtained from both stations A and B in Figure 6.3. How¬ 
ever, caution must be exercised when doing error analysis in a stepwise fashion, 
since the computed values could be correlated and the stepwise method might 
lead to an incorrect analysis of the errors. To avoid this either use GLOPOV or 
a single-derived function that includes all quantities observed in the calculation 
of the elevation. This second method is demonstrated as follows. 

From the sine law, the solution of AI and BI can be derived as 

., AB sin B AB sin B 

A j — _ — _ 

sin [180° - (A + f?)] sin (A + B) 

ABsinA 

lx/ — —- 

sin (A + B) 

Using Equations (6.22) and (6.23), the elevations for C from stations A and 
B are 


( 6 . 22 ) 

(6.23) 


Ele\ Ci = AI tan v, + Elev A + hi A 
EIev Ce = BI tan v 2 + Elev B + hi B 


(6.24) 

(6.25) 
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Thus, the chimney’s elevation is computed as the average Equations (6.24) 
and (6.25) or 

Elev c = i {Elev CA + Elev C]i ) (6.26) 

Substituting Equations (6.22) through (6.25) into Equation (6.26), a single 
expression for the chimney elevation can be written as 


Elev c = j 

+ 


AB sin B tan Vj 

Elev A + hi A + —;----— + Elev B + hi B 


sin (A + B) 


AB sin A tan v 2 
sin (A + B) 


(6.27) 


From Equation (6.27), the elevation of C is 1316.49 ft. To perform the error 
analysis, Equation (6.16) is used. In this complex problem, it is often easier to 
break the problem into smaller parts. This can be done by numerically solving 
the necessary partial derivatives from Equation (6.16) before finally squaring 
and summing the results. From Equation (6.27), 


dElev c dElev c 1 

dElev A dElev B 2 

dElev c dElev c ) 

dhi A dhi B 2 

From Equation (6.27), 


dElev c 

dAB 

dElev c 

dA 


dElev c 

dB 

dElev c 

dv x 

dEIev c 

dv 2 


1 /sin^tanv,+sin^4tanv 7 \ 

1 1 \ — n nsi qq 

2 V 

AB 

sin (A + B) ) 

- cos (A + B) (sin B tan Vj + sin A tan v 2 ) 

2 

sin 2 (A + B) 

3.78596 

AB 

- cos (A + B) (sin B tan v, + sin A tan v 2 ) 

2 

sin 2 (A + B) 

6.40739 


cos A tan v 2 
sin (A + B) 


cos B tan Vj 
sin (A + B) 


AB sin B 

2 sin (A + 5)cos 2 V! 


44.52499 


AB sin A 

2 sin (A + 5)cos 2 v 2 


48.36511 


Again, for compatibility of the units in this problem, all angular errors 
are converted to their radian equivalents by dividing each by 206,264.8"/rad. 
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Finally, using Equation (6.16), the variance and error are 


/ dEIev 


Elev c y dEIev A 
/ dEIev c 


*-* Elev A J E 

2 


+ 


/ dEIev c 
\ dEIev B 

( dEIev c 


dhi 


hi , 


B 


0 *( 


( dEIev c 
dhi A 

( dEIev c 


S hi 


+ 


/ dEIev c ( 


J Elev r 


dB 

2 


( dEIev c 

+ (V S - 


dA 


( dEIev c 

+ \~s^r • 


^0006^ + ^(E004 y + 2 ^ 0 . 005 )" + (0.08199 xO.018) 2 

+ (3.78596 x 4.1693 x 1(T 5 ) 2 + (6.40739 x 5.4783 x 1(T 5 ) 2 
+ (44.52499 x 1.9877 x 10~ 5 ) 2 + (48.36511 x 2.4725 x 10~ 5 ) 2 

1 0.003 2 + 0.002 2 + 2(0.0025) 2 + 0.0015 2 + 0.00016 2 

_ Y + 0.00035 2 + 0.00089 2 + 0.0012 2 

= ±0.0055 ft = ±0.01 ft. 


Thus, the elevation of point Cis 1316.49 ± 0.01 ft. Also note that the largest 
errors are due to the uncertainties in the elevations of A and B and the observed 
heights of the instrument stations at these stations. 


6.4 SOFTWARE 

The computations in this chapter can be time-consuming and tedious often 
leading to computational errors in the results. It is often more efficient to pro¬ 
gram these equations in a computational package. The programming of the 
examples in this chapter is demonstrated in the Mathcad® electronic book on 
the companion website for this book. Figure 6.4 shows a partial listing of a 
Mathcad® worksheet used to solve Example 6.3. Notice that a function called 
radian was used to convert angles from sexagesimal units to radian units. After 
all of the variables for the problem are created, the problem is solved by creating 
an equation that looks very similar to those written in this book. The results 
of each expression are shown to the right of the equation. Oftentimes, the time 
that is spent learning a new programming language is more than rewarded in 
its efficient use to solve multiple problems. For example, the same worksheet 
can be used to solve problems that are similar to that in Example 6.3. 

Another efficient method of programming these types of problems 
is to use a spreadsheet. In some spreadsheets, cells can be named, and 
thus equations can be entered using variables. For example, the expres¬ 
sion for the " E yj c , which is EC/A in Figure 6.5, was entered as AB/2* 
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COMPUTATIONS 


AB sin(B) 

AI .= - 

sin(A + B) 

AI = 87.233 

nI . AB sin(A) 
sin(A + B) 

BI = 95.730 

Eleven := AI tan^vj) + Ekv^ + hi^ 

Hev CA = 1316.491 

EIcvcb := BI-tan^v2j + Elcs-g + hig 

Bcn cb = 1316 495 


& 

d 

& 


b := 


j f sin(B) tan^vj j + sm(A) 

" 2 \ sn(A + B) J 


AB 


AB 

2 


-cos(A + B) (sin(B) tan(vj j + sm(A) -tan ^ 2 )) cos(A)-tan(v 2 ) 

2 


sm(A + B)“ 


sin(A + B) 


-cos(A + B) ^sm(B) tan^vj j + sm(A) tan^vjjj cos(B) tan^vj j 


sin (A + B)~ 


sin(A + B) 


c = 0 081992 


d = 3.785962 


c = 6.407395 


FIGURE 6.4 Partial listing of Example 6.3 calculated in Mathcad. 


A 

B 

c 

D 

E 

F 

G 

1 Example 6.3 





2 AB 

136.45 

±0.018 


radian 


3 



S 

Angle 

S 

4 A 

44‘ 

12’ 

34" 

±8.6 

0.771600 

4.1694E-05 

5 B 

39" 

26' 

56" 

±11.3 

0.688513 

5.4784E-05 

6 k 

8' 

12' 

47" 

±4.1 

0.143345 

1.9877E-05 

7 |v 2 

5* 

50’ 

10” 

±5.1 

0.101859 

2.4725E-05 

8 





9 Elev A 

1298.65 

±0.006 


6i» 

5.25 

±0.005 

10 Elev s 

1301.53 

±0.004 


hi e 

5.18 

±0.005 

11 





12 Elev c 

1316.493 

±0.005 




13 1 





14 Partial derivatives 





15 Ec/AB 

0.081710 





16 EC/A 

3.785962 





17 EC/B 

6.407395 





18 Ec/vl 

44.524990 





19 Ec/v2 

48.365113 






FIGURE 6.5 Example 6.3 performed in a spreadsheet. 

((-COS (A + B) * (SIN (B) * TAN (VA) + SIN (A) * TAN (VB)))/ (SIN (A + B)) A 2 
+ (COS(A)*TAN(VB))/SIN(A+B)) where AB referred to the cell containing 
the distance AB, A the cell containing the angle A in radian units, B the cell 
containing the angle B in radian units, VA the cell containing the altitude 
angle v, in radian units, and VB the cell containing the altitude angle v 2 in 
radian units. Similarly, the other expressions were created using the named 
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cells. While this method is not as clear as using a program such as Mathcad®, 
when an expression is entered carefully, the same results can be computed. 
Again, the resultant spreadsheet can be used to solve similar problems by 
simply change the data entry values. 

6.5 CONCLUSIONS 

Errors associated with any indirect measurement problem can be analyzed as 
described above. Besides being able to compute the estimated error in a func¬ 
tion, the sizes of the individual errors contributing to the functional error can 
also be analyzed. This identifies those observations whose errors are most criti¬ 
cal in reducing the functional error. An alternative use of the error propagation 
equation involves computing the error in a function of observed values prior 
to fieldwork. The calculation can be based on the geometry of the problem and 
the observations that are included in the function. The estimated errors in each 
observed value can be varied to correspond with those estimated using differ¬ 
ent combinations of available equipment and field procedures. The particular 
combination that produces the desired accuracy in the final computed function 
can then be adopted in the field. This analysis falls under the heading of survey 
planning and design. This topic is discussed further in Chapters 7, 19, and 21. 

PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

*6.1 In running a line of levels, 24 instrument setups are required, with a 
backsight and foresight taken from each. For each rod reading, the esti¬ 
mated error is ±1.5 mm. What is the error in the measured elevation 
difference between the origin and terminus? 

6.2 The estimated error in each angle of a 10-sided traverse is ±2.6". What 
is the estimated error in the angular misclosure of the traverse? 

6.3 In Problem 2.10 compute the estimated error in the overall distance as 
measured by both the 100-ft and 200-ft tapes. Which tape produced the 
smallest estimated error? 

6.4 Determine the estimated error in length of AE that was observed in 
sections as follows: 


Section 

Observed Length (m) 

Standard Deviation (mm) 

AB 

323.532 

±3.2 

BC 

465.083 

±3.3 

CD 

398.706 

±3.2 

DE 

120.683 

±3.0 
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*6.5 A slope distance is observed as 2508.98 ± 0.013 ft. The zenith angle is 
observed as 98°05'26" ± 4.3". What are the horizontal distance and its 
estimated error? 

6.6 A slope distance is observed as 3581.98 ± 0.015 ft. The zenith angle is 
observed as 82°03'25" ± 9.5". What are the horizontal distance and its 
estimated error? 

6.7 A rectangular parcel has dimensions of 648.97 ± 0.018 ft by 853.03 ± 
0.022 ft. What is the area of the parcel and the estimated error in this 
area? 

6.8 Same as Problem 6.7 except the dimensions are 536.792 ± 0.042 m by 
600.087 ± 0.028 m. 

*6.9 The volume of a cone is given by V = ''-nr 2 h. A storage shed in the 
shape of a cone has a measured height of 30.0 ±0.1 ft and radius of 
30.0 ± 0.2 ft. What are the shed’s volume and estimated error in this 
volume? 

6.10 Same as Problem 6.9, but the measured height is 15.00 ± 0.05 m and 
radius is 15.00 ± 0.08 m. 

6.11 Using an EDM instrument the rectangular dimensions of a large build¬ 
ing 600.87 ± 0.019 ft by 350.08 ± 0.016 ft are laid out. Assuming only 
errors in distance observations, what are the 

(a) Area enclosed by the building and its standard deviation? 

(b) Perimeter of the building and its standard deviation? 

6.12 A particular total station’s reading error is determined to be ±3.0". 
After repeatedly pointing on a distant target with the same instrument, 
the observer determines an error due to both pointing and reading the 
circles of ±4.5". What is the observer’s pointing error? 

*6.13 The dimensions of a storage shed under the rafters are 100.00 ± 0.03 ft 
long, 50 ± 0.02 ft wide, by 14.03 ± 0.02 ft high. What are the volume of 
this shed and the estimated error in this volume? 

6.14 Same as Problem 6. 1 3 except the dimensions are 60.000 ± 0.003 m long, 
40.000 ± 0.003 m wide, by 4.000 ± 0.003 m high. 

6.15 An EDM instrument manufacturer publishes its instrument’s accuracy 
as ±(3 mm + 3 ppm). [Note: 3 ppm means 3 parts per million. This is a 
scaling error and is computed as (Distance x 3/1,000,000).] 

(a) What formula should be used to determine the error in a distance 
observed with this instrument? 

(b) What is the error in a 1256.78-ft distance measured with this EDM? 

6.16 Same as Problem 6.15 except the observed distance is 435.781 m. 
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6.17 As shown in the accompanying sketch, a racetrack is measured in three 
simple components; a rectangle and two semicircles. Using an EDM 
with a manufacturer’s specified accuracy of ±(3 mm + 3 ppm), the rect¬ 
angle’s dimensions measured at the inside of the track are 5280.00 ft 
by 850.00 ft. Assuming only errors in the distance observations, what 
are the 

(a) Standard deviations in each observation? 

(b) Length of the perimeter of the track? 

(c) Area enclosed by the track? 

(d) Standard deviation in the perimeter of the track? 

(e) Standard deviation in the area enclosed by the track? 

6.18 Repeat Problem 6.17, using the rectangle’s dimensions as 1600.005 ± 
0.006 m by 260.000 ± 0.003 m. 

6.19 The elevation of point C on the chimney shown in Figure 6.3 is desired. 
Field angles and distances are observed. Station A has an elevation of 
345.36 ± 0.03 ft and Station B has an elevation of 353.86 ± 0.03. The 
instrument height, hi A , at Station A is 5.53 ± 0.02 ft and the instrument 
height, hi B , at Station B is 5.52 ± 0.02 ft. Zenith angles are read in the 
held. The other observations and their estimated errors are 

AB = 203.56 ± 0.02 ft 

A = 43°15'2l" ± 6.8" B = 42°02'36" ± 5.7" 

zj = 79°22'10" ± 12.3" z 2 = 83°00'48" ± 9.8" 

What is the elevation of the stack and the standard deviation in this 
elevation? 

6.20 Same as Problem 6.19 with the following observations. 

Elev A = 248.35 ± 0.04 ft Elev B = 242.87 ± 0.04 ft 

hi A = 5.53 ± 0.01 ft hi B = 5.52 ± 0.01 ft 

A = 43°15'21" ± 6.8" B = 42°02'36" ± 5.7" 

z, = 85°22 / 30" ± 12.3" z 2 = 83°00'48" ± 9.8" 

6.21 Show that Equation (6.12) is equivalent to Equation (6.11) for linear 
equations. 

6.22 Derive an expression similar to Equation (6.9) for the function z = a x 

x 1 + a 2 x 2 + a 3 x 3 . 
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FIGURE P6.24 


PRACTICAL EXERCISES 

6.23 With an engineer’s scale, measure the radius of the circle in the accom¬ 
panying sketch 10 times using different starting locations on the scale. 

Use a magnifying glass and interpolate the readings on the scale to a 

tenth of the smallest graduated reading on the scale. 

(a) What are the mean radius of the circle and its standard deviation? 

(b) Compute the area of the circle and its standard deviation. 

(c) Calibrate a planimeter by measuring a 2-in. square. Calculate the 
mean constant for the planimeter (k — units/4 in. 2 ) and based on 10 
measurements, determine the standard deviation in the constant. 

(d) Using the same planimeter, measure the area of the circle and deter¬ 
mine its standard deviation. 

6.24 Develop a computational worksheet that solves Problem 6.19. 






CHAPTER 7 


ERROR PROPAGATION IN ANGLE 
AND DISTANCE OBSERVATIONS 


7.1 INTRODUCTION 

All surveying observations are subject to errors from varying sources. For 
example when observing an angle, the major sources of error include instru¬ 
ment placement and leveling, target placement, circle reading, and target 
pointing. Although great care may be taken in observing an angle, these error 
sources will nonetheless render inexact results. To fully appreciate the need 
for adjustments, surveyors must be able to identify the major observational 
error sources, know their effects on the observations, and understand how they 
can be modeled. In this chapter, emphasis is placed on analyzing the errors 
in observed horizontal angles and distances. Chapter 8 explains the manner 
in which these errors propagate to produce traverse misclosures. Chapter 9 
covers the propagation of errors in elevation determination. Chapter 10 shows 
how these estimated errors can be used as the foundation for a valid stochastic 
(weighting) model in a least-squares adjustment. 


7.2 ERROR SOURCES IN HORIZONTAL ANGLES 

Whether a transit, theodolite, or total station instrument was used in the 
survey, errors are present in every horizontal angle observation. Whenever an 
instrument’s circles are read, a small error is introduced into the final angular 
value. Also, in pointing to a target, a small amount of error always occurs. 
Other major error sources in angle observations include instrument and target 
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setup errors and the instrument leveling error. Each of these sources produces 
random errors. They may be small or large, depending on the instrument, the 
operator, and the conditions at the time of the angle observation. The effects of 
reading, pointing, and leveling errors can be reduced by increasing the number 
of angle repetitions. However, the effects of instrument and target setup errors 
can only be reduced by increasing sight distances. 


7.3 READING ERRORS 

Errors in reading conventional transits and theodolites are dependent on the 
quality of the instrument’s optics, the size of the smallest division of the circle, 
and the operator’s abilities, for example the ability to set and read a transit 
vernier, or to set and read the micrometer of a theodolite. Typical reading 
errors for a 1 "-micrometer theodolite can range from tenths of a second to 
several seconds. Reading errors also occur with digital instruments; their 
size being dependent on the sensitivity of the particular electronic angular 
resolution system. Manufacturers quote the estimated combined pointing and 
reading precision for an individual direction measured with both faces of the 
instrument in terms of standard deviations. Typical values range from ±1" for 
the more precise instruments to ±10" for the less precise ones. These errors 
are random, and their effects on an angle are dependent on the observation 
method and the number of repeated observations. 

7.3.1 Angles Observed by the Repetition Method 

When observing a horizontal angle by the repetition method, the circle is first 
zeroed so that angles can be accumulated on the horizontal circle. The angle is 
turned a number of times, and finally, the cumulative angle is read and divided 
by the number of repetitions to determine the average angular value. In this 
method, a reading error exists in just two positions regardless of the number of 
repetitions. When the circle is zeroed, the first reading error occurs. The second 
occurs when reading the final cumulative angle. For this procedure, the average 
angle is computed as 

a \ + ®2 + ' ' ' + a n , , 

a =- (a) 

n 

where a is the average angle, and a l ,a 2 ,..., a„ are the n repetitions of the angle. 
Recognizing that readings occur only when zeroing the plates and reading the 
final direction of angle a n and applying Equation (6.18) to Equation (a), the 
standard error in reading the angle using the repetition method is 

\J a l + a r 


n 


(7.1) 





7.3 READING ERRORS 115 


In Equation (7.1) o a is the error in the average angle due to reading, a 0 the 
estimated error in setting zero on the circle, a r the estimated error in the final 
reading, and n the number of repetitions of the angle. Note that the number 
of repetitions should always be an even number, with half being turned face I 
(direct) and half face II (reversed). This procedure compensates for systematic 
instrumental errors. 

Assuming the observer’s ability to set zero and to read the circle are equal, 
Equation (7.1) is simplified to 


°r>/2 


(7.2) 


Example 7.1 Suppose that an angle is turned six times using the repetition 
method. For an observer having a personal reading error of ±1.5", what is the 
error in the final angle due to circle reading? 


SOLUTION From Equation (7.2) 


<7 


a r 


^ 1.5" y/l 
± 6 


±0.4" 


7.3.2 Angles Observed by the Direction Method 

When a horizontal angle is observed by the directional method, the horizontal 
circle is read in both the backsight and foresight directions. The angle is the 
difference between these two readings. When multiple observations of the angle 
are made, the circle is advanced prior to each reading to compensate for the 
systematic errors. The final angle is taken as the average of all the observed 
values. Again, an even number of repetitions are made, with half of the readings 
taken in face I and half in the face II position. Since each repetition of the angle 
requires two readings, the error in the average angle due to the reading error is 
computed using Equation (6.18), which yields 

7 (A+A*+<<+ + ■ ■ ■ + ( A + "l? 

=- - - C-3) 

where ; and a r are the estimated errors in reading the circle for both the back¬ 
sight and foresight directions, respectively, and n is the number of repetitions. 
Assuming that one’s ability to read the circle is independent of the particular 
direction, so that a,.. b = a r . f = a r . Equation (7.3) simplifies to 


2 



(7.4) 
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Example 7.2 Using the same parameters of six repetitions and an estimated 
observer reading error of ±1.5" as given in Example 7.1, find the esti¬ 
mated error in the average angle due to reading when the directional method 
is used. 


SOLUTION 



±0.9" 


Note that the additional readings needed in the directional method produce a 
larger error in the angle than that obtained when using the repetition method. 


7.4 POINTING ERRORS 


Accuracy in pointing to a target is dependent on several factors. These include 
the optical qualities of the telescope, target size, the observer’s personal abil¬ 
ity to place the crosshairs on a target, and weather conditions at the time of 
observation. Pointing errors are random, and they will occur in every angle 
observation no matter what instrument is used. Since each repetition of an 
angle consists of two pointings, the pointing error for an angle that is the mean 
of n repetitions can be estimated using Equation (6.16) as 

\J 2a l 1 + 2(T p2 + ' ' ' + 2(J pn 

% = ^ - (7.5) 

p n 

In Equation (7.5) o a is the error in the angle due to pointing and 
a pi ,a pi ,...,a pt are the estimated errors in pointings for the first repetition, 
second repetition, and so on. Again, for a given instrument and observer, 
the pointing error can be assumed to be the same for each repetition (i.e., 
crpi = a = ... = a Pn = G p ) and Equation (7.5) simplifies to 



Example 7.3 An angle is observed six times by an observer whose ability to 
point on a well-defined target is estimated to be ±1.8". What is the estimated 
error in the average angle due to the pointing error? 


SOLUTION From Equation (7.6) 



± 1 . 0 " 
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7.5 ESTIMATED POINTING AND READING ERRORS 
WITH TOTAL STATIONS 


With the introduction of digital theodolites and subsequently, total station 
instruments, new standards were developed for estimating errors in angle 
observations. The standards, called International Organization for Standard¬ 
ization (ISO) 17123-3 standard, provide values for estimated errors in the 
mean of two direction measurements, one each in face left and face right. Thus, 
in terms of a single pointing and reading error, a pr , the ISO value, a ISO , can be 
expressed as 


a iso - 


(T p rV2 

2 




Using this equation, the expression for the estimated error in the obser¬ 
vation of a single direction due to pointing and reading with a digital 
theodolite is 

V = ff/soV2 (b) 


Using a procedure similar to that given in Equation (7.6), the estimated 
error in an angle measured n times and averaged due to pointing and 
reading is 


<7 


Opry/2 

\fn 


(c) 


Substituting Equation ( b ) into Equation (c) yields 

2^/so 



(7.7) 


Example 7.4 An angle is observed six times by an operator with a total station 
instrument having a published ISO 17123-3 value for the pointing and reading 
error of ±5". What is the estimated error in the angle due to the pointing and 
reading errors? 

SOLUTION From Equation (7.7) 



±4.1" 
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7.6 TARGET-CENTERING ERRORS 

Whenever a target is set over a station, there will be some error due to faulty 
centering. It can be attributed to environmental conditions, optical plummet 
errors, quality of the optics, plumb bob centering error, personal abilities, and 
so on. When care is taken, the instrument is usually within 0.001 ft to 0.01 ft of 
the true station location. Although these sources produce a constant error for 
any particular angle, it will appear as random in the adjustment of a network 
involving many stations since targets and instruments will center differently 
over the same points. More importantly, this error will be noticed in resurveys 
of the same points. 

An estimate of the effect of this error in an angle observation can be made 
by analyzing its contribution to a single direction. As shown in Figure 7.1, the 
angular error due to the centering error is dependent on the position of the 
target. If the target is online but off-center, as shown in Figure 7.1(a), the tar¬ 
get centering error does not contribute to the angular error. However, as the 
target moves to either side of the sight line, the error size increases. As shown 
in Figure 1 A(d), the largest error occurs when the target is offset perpendicu¬ 
lar to the line of sight. Letting a d represent the distance the target is from the 
true station location, from Figure 1.1(d), the maximum error in an individual 
direction due to the target centering error is 

e = (radians) (7.8) 

where e is the uncertainty in the direction due to the target centering error, 
a d the amount of a centering error at the time of pointing, and as shown in 
Figure 7.2, D is the distance from the instrument center to the target. 


& 


A- 


- D - 

(a) 

_ 

—I- g _ 

(b) 


0 C ) 




A- 




>T 


(d) 


FIGURE 7.1 Possible target locations. 
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FIGURE 7.2 Error in angle due to target centering. 


Since two directions are required for each angle observation, the contribu¬ 
tion of the target-centering error to the total angular error is 



(7.9) 


where tr is the angular error due to the target centering error, a d and a di are 
the target-centering errors at stations 1 and 2, respectively, and D x and D 2 are 
the distances from the instrument to the target at stations 1 and 2, respectively. 
Assuming the ability to center the target over a point is independent of the 
particular direction, it can be stated that a d = a di — a t . Finally, the results of 
Equation (7.9) are in radian units. To convert the results to arc seconds, it must 
be multiplied by the constant p(206,264.8 ,, /radian), which yields 



(7.10) 


Notice that the same target-centering error occurs on each pointing. Thus, 
it cannot be reduced in size by taking multiple pointings, and therefore. 
Equation (7.10) is not divided by the number of angle repetitions. This 
makes the target-centering error one of the more significant errors in angle 
observations. It also shows that the only method to decrease the size of this 
error is to increase the sight distances. 

Example 7.5 An observer’s estimated ability at centering targets over a station 
is ±0.003 ft. For a particular angle observation, the backsight and foresight 
distances from the instrument station to the targets are approximately 250 ft 
and 450 ft, respectively. What is the angular error due to the error in target 
centering? 
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SOLUTION From Equation (7.10) the estimated error is: 


V250 2 + 450 2 
* 250(450) 


0.003 X 206,264.8 "/rad = ±2.8" 


If hand-held range poles were used in this example with an estimated cen¬ 
tering error of ±0.01 ft, the estimated angular error due to the target centering 
would be 


V250 2 + 450 2 
* 250(450) 


0.01 x 206,264.8"/rar/ = ±9.4" 


Obviously, this is a significant error source if care is not taken in target 
centering. 


7.7 INSTRUMENT CENTERING ERRORS 

Every time an instrument is centered over a point, there is some error in its 
position with respect to the true station location. This error is dependent on the 
quality of the instrument and the state of adjustment of its optical plummet, 
the quality of the tripod, and the skill of observer. This error can be compensat¬ 
ing as shown in Figure 7.3 (a), or it can be at a maximum when the instrument 
is on the angle bisector, as shown in Figure 7.3 (b) and (c). However, for any 
individual setup, this error is a constant; since the instrument’s location is ran¬ 
dom with respect to the true station location, it will appear to be random in 
the adjustment of a network involving many stations. Like the target-centering 
error, it will appear also during a resurvey of the points. From Figure 7.3, the 
true angle a is 


a — (P 2 + e 2 ) — (-Pi + £]) — (Ft — Pi) + (e 2 — £ 1 ) 



FIGURE 7.3 Error in angle due to error in instrument centering. 
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where P\ and P 2 are the directions observed by the operator to the backsight 
and foresight stations, respectively, and e, and e 2 are errors in those directions 
due to faulty instrument centering. The overall error for any setup is 

£ = e 2 — £\ (7.11) 

The analysis of the error in the observed angle due to instrument centering 
errors is accomplished by propagating errors in a formula based on (x, y) coor¬ 
dinates. In Figure 7.4, a coordinate system has been constructed with the x axis 
going from the true station’s location to the foresight station. The y axis passes 
through the instrument’s vertical axis and is perpendicular to the x axis. From 
Figure 7.4, the following equations can be derived: 


ill = ip — qr 

ih = iq cos(a) — sq sin(a) (7.12) 

Letting sq = x and iq = y, Equation (7.12) can be rewritten as 

ih = y cos(a) - x sin(a) (7.13) 



FIGURE 7.4 Analysis of instrument-centering error. 
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Furthermore, in Figure 7.4, 


£ 


ih 

~D\ 



y cos a — x sin a 

D\ 


(7.14) 

(7.15) 


By substituting Equations (7.14) and (7.15) into Equation (7.11), the error 
in an observed angle due to the instrument-centering error is 


y y cos a — x sin a 
D 2 A 

Reorganizing Equation (7.16) yields 


D x y + D 2 x sin a - D 2 y cos a 
D\D 2 


(7.16) 


(7.17) 


Now because the instrument’s position is truly random, Equation (6.16) can 
be used to find the estimated angular error due to the instrument centering 
error. Taking the partial derivative of Equation (7.17) with respect to both 
x and y gives 

de _ D 2 sin a 
dx D\ D 2 

and 

de A “A cos a 

dj = D,D , <718) 

Now substituting the partial derivatives in Equation (7.18) into Equation 
(6.16) yields 


Because this error is a constant for any individual setup, the mean angle has 
the same error as a single angle, and thus it is not reduced by taking several 
repetitions. The estimated error in the position of a station is derived from a 
bivariate distribution 1 where the coordinate components are independent and 
have equal magnitudes. Assuming that estimated errors in the x and y axes are 
a x and a y , from Figure 7.5, it is seen that 


D 2 sin a 
D\D 2 


<jz + 


D j - Z> 2 cos a 
D\D 2 


(7.19) 


= 


Gj 

^2 


'The bivariate distribution is discussed in Chapter 19. 
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FIGURE 7.5 Centering errors at a station. 


Letting o E = a a , expanding the squares of Equation (7.19) and rearranging 
yields 

D 2 + Z> 2 (cos 2 a + sin 2 a) - 2 D,D 0 cos a a 2 

—=-4 (7.20) 


4 . = 


D\D\ 


Making the trigonometric substitutions of cos 2 a + sin 2 a = 1 and 
Df + D 2 2 - 2D l D 1 cosa = D 2 in Equation (7.20), taking the square 
root of both sides, and multiplying by p(206,264.8"/radian) to convert the 
results to arc seconds yields 


a 


rr 

«/ 


Z) 3 fJ, 

+- 0 

D \ D 1 vT 


(7.21) 


Example 7.6 An observer centers the instrument to within ±0.005 ft of a sta¬ 
tion for an angle with backsight and foresight distances of 250 ft and 450 ft, 
respectively. The observed angle is 50°. What is the error in the angle due to the 
instrument centering error? 


SOLUTION Using the law of cosines, D 2 =D 2 + D 2 - 2D X D 2 cos z and sub¬ 
stituting in the appropriate values, Z> 3 is found to be 


D 3 = yj 250 2 + 450 2 - 2(250)(450) cos 50° = 346.95 ft 

Substituting this value into Equation (7.21), the estimated contribution of the 
instrument centering error to the overall angular error is 


346.95 0.005 
: 250(450) 


206,264.8 "/rad = ±2.2" 


7.8 EFFECTS OF LEVELING ERRORS IN ANGLE OBSERVATIONS 

If an instrument is imperfectly leveled, its vertical axis is not truly vertical, 
and thus its horizontal circle and horizontal axis are both inclined. If while 
an instrument is imperfectly leveled it is used to observe horizontal angles, the 
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angles will be measured in some plane other than horizontal. Errors that result 
from this error source are most severe when the backsights or foresights are 
steeply inclined—for example, in making astronomical observations or travers¬ 
ing over mountainous terrain. If the bubble of the instrument was to remain 
off center by the same amount during the entire angle-observation process, the 
resulting error would be systematic. However, because an operator normally 
carefully monitors the bubble and attempts to keep it centered while turn¬ 
ing angles, the amount and direction by which the instrument is out of level 
becomes random, and hence the resulting errors tend to be random. Even if 
the operator does not monitor the instrument’s level, this error will appear to 
be random in a resurvey. 

In Figure 7.6, f represents the angular error that occurs in either the back¬ 
sight or foresight of a horizontal angle observation made with an instrument 
out of level and located at station I. The line of sight IS is elevated by the 
altitude angle v. In the figure, IS is shown perpendicular to the instrument’s 
horizontal axis. The amount by which the instrument is out of level is f d fi, 
where f d is the number of fractional divisions the bubble is off center and n 
is the bubble sensitivity. From the figure, 

SP = D tan(v) ( d ) 

and 

PP' = De (e) 

where D is the horizontal component of the sighting distance and the angular 
error e is in radians. Because the amount of leveling error is small, PP' can be 
approximated as a circular arc, and thus 

PP' =f d n(SP) (f) 


s 



FIGURE 7.6 Effects of instrument-leveling error. 
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Substituting Equation ( d) into Equation (/') yields 

PP' = f d pD tan v 


(7.22) 


Now substituting Equation (7.22) into Equation ( e ) and reducing, the error 
in an individual pointing due to the instrument leveling error is 


e = fp tan v 


(7.23) 


As noted, Figure 7.6 shows the line of sight oriented perpendicular to the 
instrument’s horizontal axis. Also, the direction a bubble runs is random. Thus, 
Equation (6.18) can be used to compute the combined angular error that results 
from n repetitions of an angle made with an imperfectly leveled instrument 
(note that each angle observation involves both a backsight and a foresight 
pointing): 



(7.24a) 



(7.24b) 


Equation (7.24a) is for altitude-angle reading instruments and 
Equation (7.24b) is for zenith-angle reading instruments where v b and 
are the altitude angles to the backsight, and foresight targets, respectively, z h 
and Zf are the zenith angles to the backsight, and foresight targets, respectively, 
and n is the number of repetitions of the angle. 

Example 7.7 A horizontal angle is observed on a hillside where the backsight 
is to the top of the hill and the foresight is at the bottom. The average zenith 
angles to the backsight and foresight are 80° and 95°, respectively. The instru¬ 
ment has a level bubble with a sensitivity of 3()"/div and is leveled to within 0.3 
div. For the average angle obtained from six repetitions, what is the contribu¬ 
tion of the leveling error to the overall angular error? 

SOLUTION Substituting the appropriate values into Equation (7.24) yields 


\j [0.3 div(30"/div) cot 80°] 2 + [0.3 div(30"/div) cot(-5°)] 2 


c. 




= ± 0 . 8 " 


As shown in Example 7.7, this error is generally small for traditional 
surveying work when normal care in leveling the instrument is taken. Thus, 
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it can generally be ignored for all but the most precise work. However, as 
noted earlier, for astronomical observations, this error can become quite large, 
due to the steeply inclined sights to celestial objects. Thus, for astronomical 
observations, it is extremely important to keep the instrument precisely leveled 
for each observation. 


7.9 NUMERICAL EXAMPLE OF COMBINED ERROR PROPAGATION 
IN A SINGLE HORIZONTAL ANGLE 

Example 7.8 Assume that an angle is observed four times with a directional- 
type instrument. The observer has an estimated reading error of ±1" and a 
pointing error of ±1.5". The targets are well defined and placed on an optical 
plummet tribrach with an estimated centering error of ±0.003 ft. The instru¬ 
ment is in adjustment and centered over the station to within ±0.003 ft. The 
horizontal distances from the instrument to the backsight and foresight tar¬ 
gets are approximately 251 ft and 347 ft, respectively. The average angle is 
65°37'12". What is the estimated error in the angle observation? 


SOLUTION The best ways to solve this type of problem is to compute esti¬ 
mated errors for each item in Sections 7.3 to 7.8 individually and then apply 
Equation (6.18). 

Error Due to Reading: Substituting the appropriate values into Equation 
(7.4) yields 


a 


11 

a r 


\" \fi 


±0.71" 


Error Due to Pointing: Substituting the 
(7.6) yields 



appropriate values into Equation 


±1.06" 


Error Due to Target Centering: Substituting the appropriate values into 
Equation (7.10) yields 


<7 


11 

a t 


V251 2 + 347 2 
251(347) 


0.003 x 206,264.8 "/rad = ±3.04" 


Error Due to Instrument Centering: From the cosine law, we have 


Z) 3 2 = 251 2 + 347 2 - 2(251)(347) cos 65°37'12" 
Z> 3 = 334 ft 
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Substituting the appropriate values into Equation (7.21) yields 


a 


It 

a t 


334 0.003 

251(347) ^ 


206,264.8"/ra<7 = ±1.68" 


Combined Error: From Equation (6.18), the estimated angular error is 


u a = Vo. 71 2 + 1.06 2 + 3 . 04 2 + 1.68 2 = ± 3 . 7 " 


In Example 7.8, the largest error sources are due to the target and instru¬ 
ment centering errors, respectively. This is true even when the estimated error 
in centering the target and instrument are only ±0.003 ft. Because of these 
error sources, many surveyors place more confidence in their observations 
than is warranted unfortunately. Since these two error sources do not decrease 
with increased repetitions, there is a limit to what can be expected from any 
survey. For instance, assume that the targets were hand-held reflector poles 
with an estimated centering error of ±0.01 ft. Then the error due to the target 
centering error becomes ±10.1". This results in an estimated angular error of 
±10.3". If the 99% probable error were computed, a value as large as ±60" 
would be possible! 


7.10 USING ESTIMATED ERRORS TO CHECK ANGULAR 
MISCLOSURE IN A TRAVERSE 

When a traverse is geometrically closed, the angles are generally checked 
for misclosure. By computing the errors for each angle in the traverse as 
described in Section 7.9 and summing the results with Equation (6.18), an 
estimate for the size of the angular misclosure is obtained. The procedure is 
best demonstrated with an example. 

Example 7.9 Assume each of the angles in Figure 7.7 were observed using 
four repetitions (2D and 2R) and their estimated errors were computed as 
shown in Table 7.1. Does this traverse meet acceptable angular closure at a 
95% level of confidence? 

SOLUTION The actual angular misclosure of the traverse is 30". The 
estimated angular misclosure of the traverse is found by applying Equation 
(6.18) with the computed errors for each angle. That is, the estimated angular 
misclosure is 




= V 8 . 9 2 + 12.1 2 + 13.7 2 + 10.0 2 + 9 . 9 2 = ±24.7" 
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TABLE 7.1 Data for Example 7.9 


Angle 

Observed Value 

Computed Error Angular 

1 

60°50'48" 

±8.9" 

2 

134° 09'24" 

±12.1" 

3 

109° 00'12" 

±13.7" 

4 

100° 59'54" 

±10.0" 

5 

13 5° 00'12" 

±9.9" 


Thus, the actual angular misclosure of 30" is greater than the value estimated 
(24.7") at a 68.3% probable error level. However, since each angle was 
turned only four times, a 95% probable error must be computed by using the 
appropriate t value from Table D.3. 

This problem begs the question of what is the appropriate number of degrees 
of freedom for the summation of angles. Only four of the angles are required 
in the summation since the remaining fifth angle can be computed from the 
other four, and thus is redundant. Since each angle is turned four times, it can 
be argued that there are 16 redundant observations; that is 12 angles at the first 
four stations and 4 at the fifth station. However, this assumes that instrumental 
systematic errors were not present in the observational process since only the 
average of a face I and face II reading can eliminate systematic errors in the 
instrument. If there are n angles and each angle is turned r times, the total 
number of redundant observations would be n{r - 1) + 1. In this case, it would 
be 5(4 - 1) + 1 = 16. 

A second approach is to account for instrumental systematic errors when 
counting redundant observations. This method requires that an angle exists 
only if it is observed with both faces of the instrument. In this case, there 
is one redundant angle at each of the first four stations, with the fifth angle 
having two redundant observations for a total of six redundant observations. 
Using this argument, the number of redundant angles in the traverse would be 
n(r/2 - 1) + 1. In this example, it would be 5(4/2 - 1) +1 = 6. 
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A third approach would be to consider each mean angle observed at each 
station to be a single observation since only mean observations are being used 
in the computations. In this case, there would be only one redundant angle for 
the traverse. Had horizon closures been observed at each station, however, the 
additional angles would add n redundant observations. 

A fourth approach would be to determine the 95% probable error at each 
station and then use Equation (6.18) to sum these 95% error values. In this 
example, each station has three redundant observations. In general, there 
would be r — 1 redundant angle observations where r represents the number 
of times the angle was repeated during the observation process. 

The last two methods are the most conservative since they allow the most 
error in the sum of the angles. The fourth method is used in this text. However, 
the surveyor must decide which method is most appropriate for their practice. 
As stated in Chapter 5, the statistician must make decisions when performing 
any test. Using the fourth method, there are three redundant observations at 
each station. To finish the problem, we construct a 95% confidence interval 
or perform a two-tailed test to determine the range of error that is statistically 
equal to zero. In this case, ? 0 . 025,3 = 3.183, the 95% probable error for the angular 
sum is 

S 95% = 3.183 (24.7") = ±78.6" 

Thus, the traverse angles are well within the range of allowable error. 
We cannot reject the null hypothesis that the error in the angles is not statis¬ 
tically equal to zero. Thus, the survey meets the minimum level of angular 
closure at a 95% probable error. However, it must be remembered that because 
of the possibility of Type II errors, we can only state that there is no statistical 
reason to believe that there might be a blunder in the angle observations. 


Example 7.9 presents another question for the statistician/surveyor. That is, 
should a surveyor allow a field crew to have this large of an angular misclo- 
sure in the traverse? Statistically, the answer would seem to be yes, but recall 
that the target and instrument centering errors only affect angle observations 
if the instrument and targets are reset after each individual observation. Since 
this is never done in practice, these two errors should not be included in the 
summation of the angles. Instead, the allowable angular misclosure should 
be based solely on the pointing and reading errors. For example if the angles 
were observed with a total station having a ISO 17123-3 standard of ±1", by 
Equation (7.7) the pointing and reading error for each angle would be 


o 



±1.4" 


By Equation (6.19), the error in the summation of the five angles would be 
±1.4"\/5 = ±3.2". Using the same critical t value of 3.183, the allowable error 
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in the angular misclosure should only be 3.183(3.2") = ±10". If this instrument 
was used in Example 7.9, the field observed angular closure of 30" would be 
unacceptable and would warrant reobservation of some or all of the angles. 

As stated in Sections (7.6) and (7.7), the angular misclosure of 78.6" com¬ 
puted in Example 7.9 will only be noticed when the target and instrument are 
reset on a survey. This most likely will happen during the resurvey. During the 
resurvey, the centering errors of the target and instrument from the original sur¬ 
vey will be present in the record directions. Thus, record azimuths or bearings 
could disagree with those determined in the resurvey by this amount, assuming 
that the equipment used in the resurvey is comparable or of higher quality than 
that used in the original survey. 


7.11 ERRORS IN ASTRONOMICAL OBSERVATIONS FOR AZIMUTH 

The total error in an azimuth determined from astronomical observations 
is dependent on errors from several sources, including those in timing, the 
observer’s latitude and longitude, the celestial object’s position at observation 
time, timing accuracy, instrument optics, atmospheric conditions, and others 
as identified in Section 7.2. The error in astronomical observations can be 
estimated by analyzing the hour-angle formula, which is 

sin t 

cos cp tan S - sin 0 cos t 

In Equation (7.25), z is the angle used to compute the azimuth of the celestial 
object at the time of the observation, t the t-angle of the PZS triangle at the time 
of observation, 4> the observer’s latitude, and S the object’s declination at the 
time of the observation. 

The t angle is a function of the local hour angle (LHA) of the sun or star at 
the time of observation. That is, when the LHA < 180° then t = LHA, otherwise 
t = 360° - LHA. Furthermore, the LHA is a function of the Greenwich hour 
angle (GHA) of the celestial body, and the observer’s longitude; that is, 

LHA = GHA + A (7.26) 

where A is the observer’s longitude, considered positive if eastern longitude and 
negative if western longitude. The GHA increases approximately 15° per hour 
of time, and thus, an estimate of the error in the GHA is approximately 

a, = 15V (7-27) 

where a T is the estimated error in time (in hours). Similarly, by using the dec¬ 
lination at 0 h and 24 h , the amount of change in declination per second can be 
derived, and thus, the estimated error in the hour angle determined. 



(7.25) 



7.11 ERRORS IN ASTRONOMICAL OBSERVATIONS FOR AZIMUTH 131 


Using Equation (6.16), the error in a star’s azimuth is estimated by taking 
the partial derivative of Equation (7.25) with respect to t, 5, (p, and A. To do 
this, simplify Equation (7.25) by letting 

F = cos 4> tan 5 - sin 4> cos t (7.28a) 


and 


u = 


sin t 
~F~ 


(7.28b) 


Substituting Equations (7.27), Equation (7.25) is rewritten as 


z = tan = tan l u (7.29) 

From calculus, it is known that 

dtan~ l u _ 1 du 

dx 1 + u 2 dx 

Applying this fundamental relation to Equation (7.28) and letting G repre¬ 
sent GEIA yields 

dz _ 1 du _ F 2 du 

dG 1 + [sin(G - A)/F] 2 dG F 2 + sin 2 (G - A) dG 

Now du/dG is 


du cos(G - A) sin(G — A) 

— = -----sm ip sm(G - A) 

dG F F 2 

_ cos(G - A) sin 2 ( G - A) sin <f> 

~ F Y 1 

and thus 

du _ Ecos(G - A) - sin 2 (G - A) sirup 
dG ~ T 2 


(7.31) 


Substituting Equation (7.30) into Equation (7.29) and substituting in t for 
G - A yields 


dz _ Fcost-sint sirup 
dG F 2 + sin 2 7 


(7.32) 
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In a similar fashion, the following partial derivatives are developed from 
Equation (7.25): 


dz _ sin / cos $ 

cos 2 <5(E 2 + sin 2 /) 

dz _ sin / cos / cos 4> + sin / sin cp tan S 
F 2 + sin 2 / 

dz _ sin 2 / sin <fi - F cos / 

M F 2 + sin 2 / 


(7.33) 

(7.34) 

(7.35) 


In Equation (7.35) / is the / angle of the PZS triangle, z the celestial object’s 
azimuth, 5 the celestial object’s declination, 4> the observer’s latitude, A the 
observer’s longitude, and F = cos 4> tan 8 - sin 4> cos /. 

If the horizontal angle, //, is the observed angle to the right from the line to 
the celestial body, the equation for a line’s azimuth is 


Az = z + 360° - H 


(7.36) 


Therefore, the error contributions from the horizontal angle observation 
must be included in computing the overall error in the azimuth. Since the dis¬ 
tance to the star is considered infinite, the estimated contribution to the angular 
error due to the instrument centering error can be determined with a formula 
similar to that for the target centering error with one pointing. That is, 


G 

D 


(7.37) 


where <r ; is the centering error in the instrument, and D the length of the 
azimuth line in the same units. Note that the results of Equation (7.37) are in 
radian units and must be multiplied by p to yield a value in arc seconds. 


Example 7.10 Using Equation (7.25), the azimuth to Polaris was found to 
be 0°01'31.9". The observation time was 1:00:00 UTC with an estimated error 
of a T = ±0.5 S . The Greenwich hour angles to the star at 0 h and 24 h UTC 
were 243°27'05.0" and 244° 25' 50.0", respectively. The LHA at the time 
of the observation was 181°27'40.4". The declinations at 0 h and 24 h were 
89° 13'38.18" and 89°13'38.16", respectively. At the time of observation, the 
declination was 89°13'38.18". The clockwise horizontal angle observed from 
the backsight to a target 450.00 ft was 221°25'55.9". The observer’s latitude 
and longitude were scaled from a map as 40°13'54"N and 77°01'51.5"W, 
respectively, with estimated errors of ±1". The altitude angle to the star was 
39°27'33.1". The observer’s estimated errors in reading and pointing are ±1" 
and ±1.5", respectively, and the instrument was leveled to within 0.3 of a 
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division with a bubble sensitivity of 25"/div. The estimated error in instrument 
and target centering is ±0.003 ft. What is the azimuth of the line and its 
estimated error? What is the error at the 95% level of confidence? 

SOLUTION The azimuth of the line is Az = 0°01'31.9" + 360-221°25'55.9" 
= 138°35'36". Using the Greenwich hour angles at 0 h and 24 h , an error of 0.5 s 
time will result in an estimated error in the GHA of 

, 360° + (244°25'50.0" - 243°27'05.0") A ncJ _ _ n cV , 

I » it 3 1 / .D 

24 a x 3600 i//! 


Since t = 360° - LHA = 178°32'19.6", Fin the Equations (7.29) through 
(7.34) is 

F = cos40°13'54" tan 89°13'38.18" - sin40°13'54" cos 178°32'19.6" 

= 57.249 

The error in the observed azimuth can be estimated by computing the indi¬ 
vidual error terms as 


(a) From Equation (7.32) the error with respect to the GHA, G, is 

dz = 57.249 cos 178°32'19.6" - sin 2 178°32 / 19.6 // sin40°13 / 54" _ 2 „ 
dG a °~ 57.249 2 + sin 2 178°32'19.6" 

= ±0.13" 


(b) By observing the change in declination, it is obvious that for this observa¬ 
tion, the error in a time of 0.5 s is insignificant. In fact, for the entire day, 
the declination changes only 0.02". This situation is common for stars. 
However, the sun’s declination may change from only a few seconds daily 
to more than 23 minutes per day, and thus, for solar observations, this 
error term should not be ignored. 

(c) From Equation (7.34), the error with respect to latitude, 0, is 


dz _ sin t cos t cos 0 + sin t sin cfi tan 5 
d <P ^ ± F 2 + sin 2 t 




±0.0004" 


(d) From Equation (7.35), the error with respect to longitude, 2, is 


sin 2 (178°32 / 19.6") sin(40°13 / 54") - 57.249 cos(178°32'l9.6") 


x T 


= ± 0 . 02 " 


57.249 2 + sin 2 (178°32 / 19.6") 
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(e) The circles are read both when pointing on the star and on the azimuth 
mark. Thus, from Equation (7.2), the reading contribution to the esti¬ 
mated error in the azimuth is 

<r ar = ±a r \p2 = ±\"\[l = ±1.41" 

(f) Using Equation (7.6), the estimated error in the azimuth due to pointing 
is 

=±a„V2 = ±l-5"V2 = ±2.12" 

u p r 

(g) From Equation (7.8), the estimated error in the azimuth due to target 
centering is 


a" =±- = ±±ttt 206,264.8"/rar/ = ±1.37" 

D 450 ' 

(h) Using Equation (7.37), the estimated error in the azimuth due to instru¬ 
ment centering is 


u" = ±j} = ±Tj^206,264.8"/ra(/= ±1.37" 

(i) From Equation (7.23), the estimated error in the azimuth due to the 
leveling error is 

% = ±f d p tanv = ±0.3(25" tan 39°27'33.1") = ±6.17" 

Parts (a) through (i) are the errors for each individual error source. Using 
Equation (6.18), the estimated error in the azimuth observation is 

o t az = y (0.13") 2 + (1.32") 2 + (0.02") 2 + (0.0004") 2 + (2.12") 2 + 2(1.37") 2 + (6.17") 2 
= ±7.0" 

Using the appropriate t value of ? 0 . 025 ,i from Table D.3, the 95% error is 
a A: = ±12.705(7.0") = ±88.9" 

Notice that in this problem, the largest error source in the azimuth error is 
caused by the instrument leveling error. 
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7.12 ERRORS IN ELECTRONIC DISTANCE OBSERVATIONS 

All electronically measured distance observations are subject to instrumental 
errors that manufacturers list as a constant, a, and scalar, b, error. A typical 
specified accuracy is ±(a + b ppm). In this expression, a is generally in the 
range of 1 to 10 mm, and b is a scalar error, which typically has the range 1 
to 10 parts per million (ppm). Other errors involved in electronically measured 
distance observations stem from the target and instrument centering errors. 
Since in any survey involving several stations these errors are random, they 
should be combined using Equation (6.18). Thus, the estimated error in an 
EDM observed distance is 

<j D = yj a 2 + of + a 2 + (D x b ppm) 2 (7.38) 

where a D is the error in the observed distance Z), the instrument miscentering 
error, o t , reflector miscentering error, and a and b the instrument’s specified 
accuracy parameters. 

Example 7.11 A distance of 453.87 ft is observed using an EDM with a 
manufacturer’s specified accuracy of ±(3 mm + 3 ppm). The instrument is 
centered over the station with an estimated error of ±0.003 ft, and the reflector, 
which is mounted on a handheld prism pole, is centered with an estimated 
error of ±0.01 ft. What is the error in the observed distance? What is ^95 value? 

SOLUTION Converting millimeters to feet using the survey foot 2 definition 
gives us 

0.003 39,37 — = 0.0098 ft 
12 in. 

The scalar portion of the manufacturer’s estimated standard error is 
computed as 

distance X b 

1,000,000 

In this example, the error is 453.87(3/1,000,000) = ±0.0014 ft. Thus, 
according to Equation (7.38), the distance error is 

a = yj (0.003) 2 + (0.01) 2 + (0.0098) 2 + (0.0014) 2 = ±0.0144 ft 
Using the appropriate t value from Table 3.2, the 95% probable error is 
E 95 = 1.96o = ±0.028 ft 


2 The survey foot definition is 1 meter = 39.37 inches, exactly. 
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Notice in this example that the instrument’s constant error and target 
centering errors are the largest single contributors to the overall error in 
the observed distance. Furthermore, since both errors are constants, their 
contribution to the total error is unchanged regardless of the distance. Thus, 
for this particular EDM instrument, distances under 200 ft could probably be 
observed more accurately with a calibrated steel tape. However, this statement 
is dependent on the terrain, the quality of the instrument, and skill of the 
surveyor in using a steel tape. 

Furthermore, notice that when computing the 95% probable error, the criti¬ 
cal t value is obtained from the normal distribution. This is due to the fact that 
distance observations are seldom repeated, which means that the instrument 
and reflector are reset between each observation and atmospheric conditions 
have changed. As an example, simply pushing the distance measurement 
button three times does not constitute independent observations of a distance 
since the instrument and reflector setups are never moved and sufficient time 
does not pass to affect atmospheric conditions. 


7.13 CENTERING ERRORS WHEN USING RANGE POLES 

The estimated centering error in the EDM reflector, total station target, or 
GNSS receiver that is attached to the top of a range pole can be significant. 
From geometry we know that the amount the top of a pole is displaced from 
its point at the bottom is computed as 


(7.39) 


S = R9 


where S is the displacement of the top of the pole from its bottom point, R the 
length of the pole, and 9 the angular shift from vertical of the pole, which can be 
computed as f d n with variables as previously defined for Equation (7.22). Using 
Equation (6.16) and substituting/;/* for 9, the centering error of a reflector or 
GNSS receiver is 



(7.40) 


where a t is the centering error of the reflector or GNSS receiver, 9 the angular 
displacement from vertical of the target/receiver in radians, and a R the uncer¬ 
tainty in R. According to Franklin and Meyer (2016), a g follows a Rayleigh 
distribution and can be computed as 


a e =f d /r\/0.5(4 - ji) 


(7.41) 
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Assume in Equation (7.41) that a calibrated circular vial is within one-half 
of a division of being centered, which would be 1 mm for a 2-mm division. Then 
a g is computed as 


<j g = 0.5(0.011636)\/0.5(4 - n) = 0.003811 rad 


where 0.011636 is 40' converted to radian units. Further assume that the range 
pole is 2 m ± 0.002 m, the estimated centering error in the reflector is given by 
Equation (7.40) as 



= Vo. 000023 2 + 0 . 007623 2 = ±0.008 m 


Note in this example that the error in the height of the rod has a minimal 
contribution to the overall error in centering when it is a reasonably accurate 
value. Thus, Equation (7.41) can be simplified as 


(7.42) 


a t = Rag 


where R and a g are as previously defined. 

7.14 SOFTWARE 

The computations demonstrated in this chapter are rather tedious and 
time-consuming when done by hand, and this often leads to mistakes. This 
problem, and many others in surveying that involve repeated computations 
of a few equations with different values, can be done conveniently with a 
spreadsheet, worksheet, or program. On the companion website for this book 
is an electronic book prepared with Mathcad demonstrating the programming 
of the computational examples in this chapter. Figure 7.8 depicts a spread¬ 
sheet used to compute estimated errors in an angle. In this spreadsheet, the 
user enters the ISO 17123-3 standard for a total station instrument and the 
estimated instrument and target setup errors. Information about the angle 
including the stations, angular value and its standard deviation, number 
of times the angle was turned, and the backsight and foresight distances. 
The spreadsheet then computes the estimated errors in the angle due to 
pointing and reading and setup errors. This spreadsheet C7.xls is available 
on the companion website that accompanies this book. It demonstrates the 
use of spreadsheet to solve Examples 7.4 through 7.6. When practicing the 
following problems, the reader should consider writing software to perform 
the aforementioned computations. 
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FIGURE 7.8 Excel® worksheet for computing estimated errors in angles. 


PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

7.1 Plot a graph of vertical angles from 0° to 60° versus the error 
in horizontal angle measurement due to an instrument leveling 
error of 10". 

7.2 For a direction with sight distances to the target of 100, 200, 300, 400, 
600, 1000, and 1500 ft, construct: 

(a) A table of estimated standard deviations due to target centering 
when a, = ±0.005 ft. 

(b) A plot of distance versus the standard deviations computed in 
part (a). 

7.3 For an angle of size 100° with equal sight distances to the targets of: 
100, 200, 300, 400, 600, 1000, and 1500 ft, construct: 

(a) A table of standard deviations due to instrument centering when 
a t = ±0.005 ft. 

(b) A plot of distance versus the standard deviations computed in 
part (a). 

*7.4 Assuming a setup errors of <r ; = ±0.003 ft and a t = ±0.005 ft, what 
is the estimated error in a distance of length 864.36 ft, using an EDM 
with stated accuracies of 3 mm + 3 ppm? 

7.5 Similar to Problem 7.4, except the setup errors are o, = ±3 mm and 
a t = ±5 mm and the distance is 304.597 m. 

7.6 Similar to Problem 7.4, except the length of the distance is 654.34 ft 
and the stated accuracies for the EDM are 5 mm + 5 ppm. 

7.7 Assuming a setup errors of d, = ±0.003 ft and a, = ±0.01 ft, what is the 
estimated error in a distance of length 2208.36 ft using an EDM with 
stated accuracies of 3 mm + 3 ppm? 
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7.8 Similar to Problem 7.7, except that the setup errors are ±1.5 mm and 
the distance has a length of 678.098 m. 

*7.9 A 39°06'22" angle having a backsight length of 125.003 m and fore¬ 
sight length of 67.836 m is observed with a total station having a stated 
ISO 17123-3 standard of ±3" two times. Assuming instrument and tar¬ 
get centering errors of rr, = ±0.003 m and a, = ±0.003 m, what is the 
estimated error in the angle? 

7.10 Similar to Problem 7.9, except the ISO 17123-3 standard is ±2". 

7.11 Similar to Problem 7.9, except the angle is 93°03'42", backsight length 
is 155.05 ft, foresight length is 310.85 ft, the instrument and target cen¬ 
tering errors are <r, = ±0.005 ft and a t = ±0.005 ft, the angle is observed 
four times, and the instrument has a stated ISO 17123-3 standard of 
±5". What is the estimated error in the angle? 

7.12 Similar to Problem 7.11, except the ISO 17123-3 standard is ±1". 

*7.13 For the following traverse data, compute the estimated error for each 
angle if ISO 17123-3 standard is ±3", <j, = ±0.005 ft, a t = ±0.005 ft and 
the angles were each measured four times (two direct and two reverse). 
Does the traverse meet acceptable angular closures at a 95% level of 
confidence? 


Station 

Angle 

Course 

Distance (ft) 

A 

62°32'57" 

AB 

221.85 

B 

124°56'24" 

BC 

346.55 

C 

60°44'05" 

CD 

260.66 

D 

111°46'09" 

DA 

349.16 


7.14 A total station with an ISO 17123-3 standard of ±5" was used to turn 
the angles in Problem 7.13. The angles were turned four times (two 
direct and two reverse). Assume the same estimated errors in instru¬ 
ment and target centering. Does the traverse meet acceptable angular 
closures at a 95% level of confidence? 

7.15 A total station with an ISO 17123-3 standard of ±1" was used to turn 
the angles in Problem 7.13. The angles were turned two times (one 
direct and one reverse). Assume the same estimated errors in instru¬ 
ment and target centering. Does the traverse meet acceptable angular 
closures at a 95% level of confidence? 

7.16 Assuming that the instrument and target are not moved during the 
angle measurement procedure: 

(a) Does the traverse in Problem 7.13 meet acceptable misclosure at a 
95% level? 
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(b) Does the traverse in Problem 7.14 meet acceptable misclosure at a 
95% level? 

(c) Does the traverse in Problem 7.15 meet acceptable misclosure at a 
95% level? 

7.17 For the following traverse data compute the estimated error in each 
angle if a IS0 = ±2", a, = a t = ±0.005 ft, and the angles were observed 
four times (twice direct and twice reverse) using the repetition method. 
Does the traverse meet acceptable angular closures at a 95% level of 
confidence? 


Station 

Angle 

Course 

Distance (ft) 

A 

39°04'48" 

AB 

321.79 

B 

148°55'06" 

BC 

276.83 

C 

84°25'22" 

CD 

102.33 

D 

114°36'08" 

DE 

306.16 

E 

152°58'18" 

EA 

255.53 


7.18 A total station with an ISO 171123-3 standard of ±1" was used to turn 
the angles six times (3 direct and 3 reverse) in Problem 7.17. Repeat the 
problem for this instrument. 

7.19 Assuming that the instrument and target are not moved during the 
angle measurement procedure, 

(a) Does the traverse in Problem 7.17 meet acceptable misclosure at a 
95% level? 

(b) Does the traverse in Problem 7.18 meet acceptable misclosure at a 
95% level? 

7.20 An EDM was used to measure the distances in Problem 7.13. The man¬ 
ufacturer’s specified error for the instrument is ±(3 mm + 3 ppm). Using 
Oi = ±0.005 ft and a, = ±0.005 ft, calculate the estimated error in each 
distance. 

7.21 Similar to Problem 7.20, but for the distances in Problem 7.17. 
The manufacturer’s specified error for the instrument was ±(2 mm + 
2 ppm). Use a, and a, from Problem 7.17. Calculate the estimated 
error in each distance. 

7.22 The following observations and calculations were made on a sun obser¬ 
vation to determine the azimuth of a line. 
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Observation 

No. UTC 

Horizontal 

Angle 

Altitude 

Angle 

S 

LHA 

Z 

1 

16:30:00 

41°02'33" 

39°53'08" 

-3°28'00.58" 

339°54'05.5" 

153°26'51.8" 

2 

16:35:00 

42°35'28" 

40°16'49" 

-3°28'05.43" 

341°09'06.5" 

154° 59'42.4" 

3 

16:40:00 

44°09'23" 

40°39'11" 

-3°28' 10.27" 

342°24'07.5" 

156°33'39.0" 

4 

16:45:00 

45°44'25" 

41°00'05" 

-3°28'15.11" 

343°39'08.5" 

158°08'39.2" 

5 

16:50:00 

47°20'21" 

41° 19'42" 

-3°28' 19.96" 

344°54'09.5" 

159° 44'40.2" 

6 

16:55:00 

48°57'24" 

41°37'47" 

-3°28'24.80" 

346°09'10.5" 

161°21'38.9" 


The Greenwich hour angles for the day were 182°34'06.00" at 0 h UT, 
and 182°38'53.30" at 24 h UT. The declinations were -3°12'00.80" at 0 h 
and, —3°35' 16.30" at 24 h . The observer’s latitude and longitude were 
scaled from a map as 43°15'22" and 90° 13'18", respectively with an 
estimated standard error of ±1" for both values. Stopwatch times were 
assumed to be correct to within an error of ±0.5 S . A Roelofs prism 
was used to take pointings on the center of the sun. The target was 
535 ft from the observer’s station. The observer’s estimated reading 
and pointing errors were ±1.2" and ±1.8", respectively. The instrument 
was leveled to within 0.3 of a div on a level bubble with a sensitiv¬ 
ity of 20"/div. The target was centered to within an estimated error of 
±0.003 ft of the station. 

(a) What is the average azimuth of the line and its standard deviation? 

(b) What is the estimated error of the line at 95% level of confidence? 

(c) What is the largest error contributor in the observation? 
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7.23 Create computational package that will compute the errors in angle 
observations. Use the package to compute the estimated errors for the 
angles in Problem 7.13. 

7.24 Create a computational package that will compute the errors in EDM 
observed distances. Use the package to solve Problem 7.20. 





CHAPTER 8 


ERROR PROPAGATION IN TRAVERSE 
SURVEYS 


8.1 INTRODUCTION 

Even though the specifications for a project may allow lower accuracies, the 
presence of blunders in observations is never acceptable. Thus, an important 
question for every surveyor is, “How can I tell when blunders are present in 
the data?” In this chapter, we begin to address that question, and in particular, 
stress traverse analysis. This topic is discussed further in Chapters 21 and 25. 

In Chapter 6, it was shown that the estimated error in a function of obser¬ 
vations is dependent on the individual errors in the observations. Generally, 
observations in horizontal surveys (e.g., traverses) are independent. That is, 
the measurement of a distance observation is independent of the azimuth 
observation. But the latitude and departure of a line, which are computed 
from the distance and azimuth observations, are not independent. Figure 8.1 
shows the effects of the errors in distance and azimuth observations on the 
computed latitude and departure. In Figure 8.1, it can be seen that there is 
correlation between the latitude and departure; that is, if either distance or 
azimuth observation changes, it causes changes in both latitude and departure. 

Because the observations from which latitudes and departures are com¬ 
puted are assumed to be independent with no correlation, the SLOPOV 
approach [Equation (6.16)] can be used to determine the estimated error in 
these computed values. However, for proper computation of estimated errors 
in functions that use these computed values (i.e., latitudes and departures), the 
effects of correlation must be considered, and thus the GLOPOV approach 
[Equation (6.13)] will be used. 
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FIGURE 8.1 Latitude and departure uncertainties due to (a) the distance standard 
error (<r D ) and (b) the azimuth standard error ( a a ). Note that if either the distance or 
azimuth changes, both the latitude and departure are affected. 


8.2 DERIVATION OF ESTIMATED ERROR 
IN LATITUDE AND DEPARTURE 

When computing the latitude and departure of a line, the following 
well-known equations are used: 


Lat = D cos Az 

Dep — D sin Az (8.1) 


where Lat is the latitude, Dep the departure, Az the azimuth, and D the hori¬ 
zontal length of the line. To derive the estimated error in the line's latitude or 
departure, the following partial derivatives from Equation (8.1) are required in 
using Equation (6.13). 


dLat 

~dD~ 


= cos Az 


dDep 

-= sin Az 

dD 


dLat 

dAz 

dDep 

dAz 


—D sin Az 
D cos Az 


( 8 . 2 ) 


Example 8.1 A traverse course has a length of 456.87 ± 0.02 ft and an azimuth 
of 23°35'26" ± 9". What are the latitude and departure, and their estimated 
errors? 


SOLUTION Using Equation (8.1), the latitude and departure of the course 
are 


Lat = 456.87 cos(23°35'26") = 418.69 ft 
Dep = 456.87 sin(23°35 / 26") = 182.84 ft 
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The estimated errors in these values is solved using Equation (6.16) as 


^ Lat, Dep 

dLat 

dD 

dDep 
. dD 

dLat " 

dAz 

dDep 

dAz . 

K 

[o 

0 

° 2 aA 

dLat 

dD 

dLat 

- dAz 

dDep ' 

dD 

dDep 

dAz - 


1 

N> 

a 

®Lat, Dep 





17 Lat, Dep a Dep 


Substituting partial derivatives into the above yields 


cos Az 

—D sin Az 

0 . 02 2 

0 

sin Az 

D cos Az 

0 

(9 "/p) 2 


cos Az sinAz 
—D sin Az D cos Az 


(8.3) 


Notice that the angular values must be converted to radians to prevent a 
mixing of units. A close look at the units of the matrix multiplication shows 
that the final units will be ft 2 . Entering the appropriate numerical values into 
Equation (8.3), the covariance matrix is 


0.9167 -456.87(0.4002)' 


'0.0004 0 ' 

0.4002 456.87(0.9164) 


- 1 

1 

bsl ^ 

0 


0.9167 0.4002 

-456.87(0.4002) 456.87(0.9164) 


from which 


£ 


Lat, Dep 


0.00039958 

0.00000096 


0.00000096 

0.00039781 


(8.4) 


In Equation (8.4), < 7 ^ is the variance of the latitude, is the variance of the 
departure, and er 12 and cr 21 are the covariances. Thus, the standard errors are: 

<7 Lat = — VO-00039958 = + 0 . 020 ft and a Dep = = \A)-00039781 = 

±0.020 ft. Note that the off-diagonal of I* Lat Dep is not equal to zero, and thus, 
the computed values are correlated as illustrated in Figure 8.1. 
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8.3 DERIVATION OF ESTIMATED STANDARD ERRORS 
IN COURSE AZIMUTHS 

Equation (8.1) is based on the azimuth of a course. However, in practice 
traverse azimuths are normally computed from observed angles rather than 
measured directly. Thus, another level of error propagation exists in calcu¬ 
lating the azimuths from angular values. In the following analysis, consider 
that angles-to-the-right are observed and that azimuths are computed in a 
counterclockwise direction successively around the traverse using the formula 

Az c = Az P +m°+0 i (8.5) 

where Az r is the azimuth for the current course, Az P the previous course 
azimuth, and 0 , the appropriate interior angle to use in computing the current 
course azimuth. By applying Equation (6.18), the error in the current azimuth, 

Az c , is 

+ (8 - 6) 

In Equation (8.6) <r 0 is the estimated error in the appropriate interior angle 
used in computation of the current azimuth, o Azp is the estimated error in the 
azimuth of the previous course, and a Alc is the estimated error in the course 
being computed. This equation is also valid for azimuth computations going 
clockwise around the traverse. The proof of this is left as an exercise. 

8.4 COMPUTING AND ANALYZING POLYGON TRAVERSE 
MISCLOSURE ERRORS 

From elementary surveying, it is known that the following geometric con¬ 
straints exist for any closed polygon-type traverse: 


^ interior angles = (n - 2) 180°, and 

(8.7) 

^ Lat = ^ Dep = 0 

(8.8) 


Deviations from these conditions, normally called misclosures, can be cal¬ 
culated from the observations in any traverse. Statistical analyses can then be 
performed to determine the acceptability of the misclosures and check for the 
presence of blunders in the observations. If blunders appear to be present, the 
measurements must be rejected and the observations repeated. 

However, while the initial azimuth will correctly orient the traverse, its error 
does not affect the linear misclosure of the traverse. This can also be stated 
about the observed angle at the control station, since the azimuth for the first 
course is either given or assumed. Thus, the errors in these observations can be 
ignored when checking the linear misclosure of the traverse. The error in the 
initial angle should be used in checking the angular misclosure in the traverse. 
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The following example illustrates methods of making these computations for 
any closed polygon traverse. 

Example 8.2 Compute the angular and linear misclosures for the traverse 
illustrated in Figure 8.2. The observations for the traverse are given in Table 8.1. 
Determine the estimated misclosure errors at the 95% confidence level, and 
comment on whether or not the observations may contain any blunders. 



FIGURE 8.2 Link traverse example. 


TABLE 8.1 Distance and Angle Observations for Figure 8.2 


Occupied 

Sighted 

Distance 

(ft) 

S 

(ft) 

BS 

Occ 

FS 

Angle* 

S{") 

A 

B 

1435.67 

0.020 

E 

A 

B 

110°24'40" 

±3.5 

B 

C 

856.94 

0.020 

A 

B 

C 

87° 36'14" 

±3.1 

C 

D 

1125.66 

0.020 

B 

C 

D 

125°47'27" 

±3.6 

D 

E 

1054.54 

0.020 

C 

D 

E 

99°57'02" 

±3.1 

E 

A 

756.35 

0.020 

D 

E 

A 

116° 14' 56" 

£ = 540°00'19" 

±3.9 


*Each angle was measured using four repetitions. 


SOLUTION Angular Check: First the angular misclosure is checked to see if 
it is within the tolerances specified. From Equation (6.18), and using the stan- 
dar d deviations given in T able 8 .1, the angular sum should have an error within 

±\/°z 1 + + ''' + °zh 68.3% of the time. Since the angles were measured 

four times, each computed mean has three degrees of freedom, and the appro¬ 
priate t value from Table D.3 (the t distribution) is 1 0 . 025 , 3 * which equals 3.183. 
This is a two-tailed test since we are looking for the range that is statistically 
equal to zero at the selected level of confidence. If this range contains the actual 
misclosure, then there is no statistical reason to believe that the observations 








148 ERROR PROPAGATION IN TRAVERSE SURVEYS 


contain a blunder. In this case, the angular misclosure at a 95% confidence level 
is estimated as 

angles = 3.183V3.5 2 + 3.1 2 + 3.6 2 + 3.1 2 + 3.9 2 = ±24.6" (8.9) 

Using the summation of the angles in Table 8.1, the actual angular misclo¬ 
sure in this problem is 


540°00'19" - (5 - 2) 180° = 19" 

Thus, the actual angular misclosure for the traverse (19") is within its esti¬ 
mated range of error, and there is no reason to believe that a blunder exists in 
the angles. 

Azimuth Computations: In this problem, no azimuth is given for the first 
course. However, to solve the problem, the azimuth of the first course can be 
assumed as 0°00'00" and to be free of error. Since only geometric closure on the 
traverse is being checked, not the orientation of the traverse, this can be done 
even when the initial course azimuth is observed. For the data of Table 8.1, 
and using Equations (8.5) and (8.6), the values for the course azimuths and 
their estimated errors are computed and listed in the Table 8.2. 


TABLE 8.2 Estimated Errors in the Computed Azimuths of Figure 8.2 


From 

To 

Azimuth 

Estimated Error 

A 

B 

0°00'00" 

0" 

B 

C 

267° 3 6'14" 

±3.1" 

C 

D 

213°23'41" 

V3.1 2 + 3.6 2 = ±4.8" 

D 

E 

133°20'43" 

V4.8 2 + 3.1 2 = ±5.7" 

E 

A 

69°35'39" 

V5.7 2 + 3.9 2 = ±6.9" 


Computation of Estimated Linear Misclosure: Equation (6.13) properly 
accounts for correlation in the latitude and departure when computing the lin¬ 
ear misclosure of a traverse. Applying the partial derivatives of Equation (8.2) 
to the latitudes and departures, the Jacobian matrix, A, has the form 

A = 

cos Az ab —AB sin Az ab 
sin Az ab AB cos Az ab 
0 0 

0 0 


cos Az ea -EA sin Az ea 
sin Az ea EA cos Az ea 


0 0 ••• 0 

0 0 ••• 0 

cos Az bc -BC sin Az bc 0 

sin Az bc BC cos Az bc 0 


0 

0 

0 

0 


0 

0 


0 

0 


0 

0 


0 

0 


( 8 . 10 ) 
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Because the lengths and angles were observed independently, they are 
uncorrelated. Thus, the appropriate covariance matrix, 2, for solving this 
problem using Equation (6.13) is 


2 = 


IV 


AB 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 


0 0 

2 

0 

°BC 
0 
0 
0 
0 
0 
0 
0 


0 

0 

0 

m 

0 

0 

0 

0 

0 

0 


a 


0 

0 

0 

0 

2 

CD 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

m 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

X 2 

DE 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 


c-ry 


0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

7 Ia 

0 


0 

0 

0 

0 

0 


0 

0 


0 


0 



2 


( 8 . 11 ) 


Again, notice that the estimated errors for the computed azimuths are 
converted to their equivalent radian values to ensure that the results of the 
computations will yield estimated errors in linear units. Substituting numerical 
values for this problem into Equations (8.10) and (8.11), the covariance 
matrix, 2 ifl? D is computed for the latitudes and departures AXA T , or 


2 


Lat, Dep 


0.00040 0 0 0 

0 0 0 0 

0 0 0.00017 0.00002 

0 0 0.00002 0.00040 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 


0 0 

0 0 

0 0 

0 0 

0.00049 0.00050 
0.00050 0.00060 
0 0 

0 0 

0 0 

0 0 


0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0.00064 -0.00062 0 0 

-0.00062 0.00061 0 0 

0 0 0.00061 0.00034 

0 0 0.00034 0.00040 


( 8 . 12 ) 


By taking the square roots of the diagonal elements in the 2 Laf D matrix 
[Equation (8.12)], the errors for the latitude and departure of each course 
are found. That is, the estimated error in the latitude for course BC is the 
square root of the “3,3” element in Equation (8.12), and the estimated error 
in the departure of BC is the square root of the “4,4” element. In a similar 
fashion, the estimated errors in latitude and departure can be computed for 
any other course. 
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The formula for determining the linear misclosure of a closed polygon 
traverse is 


LC = Y (Lat AB + Lat BC + • • • + Lat EA f + (Dep AB + Dep BC + • • • + Dep EA ) 2 

(8.13) 

where LC is the linear misclosure. To determine the estimated error in the lin¬ 
ear misclosure, Equation (6.13) is applied to the linear misclosure formula in 
Equation (8.13). The necessary partial derivatives from Equation (8.13) for 
substitution into Equation (6.13) must first be determined. The partial deriva¬ 
tives with respect to the latitude and departure of course AB are 


dLC _ Z Lats dLC _ Z Deps 
dLat AB LC dDep AB LC 


(8.14) 


Notice that these partial derivatives are independent of the course. Also, the 
other courses have the same partial derivatives as given by Equation (8.14), and 
thus, the Jacobian matrix for Equation (6.13) has the form 

^ Lats ^ Deps ^ Lats ^ Deps ^ Lats ^ Deps 
A ~ LC LC EC LC LC LC (8 ' 15) 


As shown in Table 8.3, the sum of the latitudes is -0.083, the sum of 
the departures is 0.022, and LC = 0.086 ft. Substituting these values into 
Equation (8.15), which, in turn, is substituted into Equation (6.13), yields 


= [-0.9674 0.2531 


= [0.00226] 


'-0.9674' 

0.2531 


-0.9674 0.2531 \^ LauDep 


-0.9674 

0.2531 


(8.16) 


TABLE 8.3 Latitudes and Departures for Example 8.2 


Course 

Latitude 

Departure 

AB 

1435.670 

0.000 

BC 

-35.827 

-856.191 

CD 

-939.812 

-619.567 

DE 

-723.829 

766.894 

EA 

263.715 

708.886 

LC=s/c 

E = -0.083 

-0.083) 2 + (0.022) 2 = 0.086 ft 

E = 0.022 
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In Equation (8.16), X LC is a single element covariance matrix; that is, the 
variance of the linear closure and can be called a 2 LC . Also, X / u( _ Dep is the matrix 
given by Equation (8.12). To compute the 95% confidence interval, a t value 
from Table D.3 (the t distribution) must be used with a = 0.025 and 3 degrees of 
freedom. 1 The estimated misclosure for a traverse at a (1 - a) level of confidence 
is t a i 2 ^ L c- Again we are checking to see if the traverse misclosure falls within 
a range of errors that are statistically equal to zero. This requires placing a/2 
into the upper and lower tails of the distribution. Thus, the estimated error in 
the traverse closure at a 95% level of confidence is 

<j lc = *0.025,3)/of = 3.183 V0-00226 = ±0.15 ft 

This value is well above the actual traverse linear misclosure of 0.086 ft, and 
thus there is no reason to believe that the traverse contains any blunders. 


In Example 8.2, we failed to reject the null hypothesis; that is, there was no 
statistical reason to believe there were errors in the data. However, it is impor¬ 
tant to remember that this does necessarily imply that the observations are free 
from error. There is always the possibility of a Type II error. For example, if 
the computations were supposed to be performed on a map projection grid, 2 
but the observations were not reduced, the traverse would still close within 
acceptable tolerances. However, the computed results would be incorrect since 
all the distances would be either too long or too short. Another example of 
an undetectable systematic error is an incorrectly entered EDM-reflector con¬ 
stant (see Problem 2.23). Again, all the observed distances would be either too 
long or too short, but the traverse misclosure would still be within acceptable 
tolerances. 

Surveyors must always be aware of systematic instrumental errors and fol¬ 
low proper held and office procedures to remove these errors. As discussed, 
simply passing a statistical test does not imply directly that the observations are 
error or mistake free. However, when the test rejects the null hypothesis, only 
a Type I error can occur at an a level of confidence. Dependent on the value 
of a, rejection of the null hypothesis is a strong indicator of problems within 
the data. 

1 A closed polygon traverse has 2(« - 1) unknown coordinates with 2n + 1 observations, where n is 
the number of traverse sides. Thus, the number of degrees of freedom in a simple closed traverse is 
always In + 1 — 2 (n - 1) = 3. For a five-sided traverse, there are five angle and five distance obser¬ 
vations plus one azimuth. Also, there are four stations, each having two unknown coordinates, 
thus 11-8 = 3 degrees of freedom. 

2 Readers who wish to familiarize themselves with map projection computations should refer to 
Appendix F and the electronic book that accompanies this book. 
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8.5 COMPUTING AND ANALYZING LINK TRAVERSE 
MISCLOSURE ERRORS 

As illustrated in Figure 8.3, a link traverse begins at one station and ends on a 
different one. Normally, they are used to establish the positions of intermedi¬ 
ate stations, as in A through D of the figure. The coordinates at the endpoints, 
Stations 1 and 2 of the figure, are known. Angular and linear misclosures are 
also computed for these types of traverse, and the resulting values used as the 
basis for accepting or rejecting the observations. In a link traverse, the error 
in the initial azimuth and angle are important in checking both the angular 
and linear misclosure of the traverse. Furthermore, the error in the closing 
azimuth is considered when checking the angular misclosure. It does not affect 
the linear misclosure of the traverse. Example 8.3 illustrates the computational 
methods. 


Example 8.3 Compute the angular and linear misclosures for the tra¬ 
verse illustrated in Figure 8.3. The observed data for the traverse are 
given in Table 8.4. Determine the estimated misclosures at the 95% confi¬ 
dence level, and comment on whether or not the observations contain any 
blunders. 

SOLUTION Angular Misclosure: In a link traverse, angular misclosure is 
found by computing initial azimuths for each course, and then subtracting the 
final computed azimuth from its given counterpart. The initial azimuths and 
their estimated errors are computed using Equations (8.5) and (8.6) and are 
shown in Table 8.5. 

The difference between the azimuth computed for course D2 (84° 19'22"), 
and its actual value (264° 19'13" - 1 80°) is +9", Using Equation (6.18), the 
estimated error in the difference is Vll-O 2 +4.1 2 = ±11.7”, and thus there is 
no reason to assume that the angles contain blunders. 



FIGURE 8.3 Closed-link traverse. 
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TABLE 8.4 

Data for Link Traverse in 

Example 8.3 



Distance Observations 


Control Stations 


From 

To 

Distance (ft) 

5 (ft) 

Station 

X(ft) 

Y (ft) 

1 

A 

1069.16 

±0.021 

1 

1248.00 

3979.00 

A 

B 

933.26 

±0.020 

2 

4873.00 

3677.00 

B 

C 

819.98 

±0.020 




C 

D 

1223.33 

±0.021 




D 

2 

1273.22 

±0.021 





Angle Observations 



Azimuth Observations 


BS Occ 

FS 

Angle 

S(") 

From 

To 

Azimuth 

sn 

1 A 

B 

66°16'35" 

±4.9 

1 

A 

197°04'47" 

±4.3 

A B 

C 

205° 16'46" 

±5.5 

D 

2 

264° 19'13" 

±4.1 


B 

C 

D 

123°40'19" 

±5.1 

C 

D 

2 

212°00'55" 

±4.6 


TABLE 8.5 Computed Azimuths and Their Uncertainties 


Course 

Azimuth 

ff(") 

1 A 

197°04'47" 

± 4.3 

AB 

83°21'22" 

± 6.5 

BC 

108°38'08" 

± 8.5 

CD 

52°18'27" 

± 9.9 

D2 

84°19'22" 

±11.0 


Linear Misclosure: First, the actual traverse misclosure is computed using 
Equation (8.1). From Table 8.6, the total change in latitude for the traverse is 
-302.128 ft and the total change in departure is 3624.968 ft. From the control 
coordinates, the cumulative change in X and Y coordinate values is 

AX = X 2 - X, = 4873.00 - 1248.00 = 3625.00 ft 
AF = Y 2 - Y x = 3677.00 - 3979.00 = -302.00 ft 

The actual misclosures in departure and latitude are computed as 

A Dep = Yj De P ~ {X 2 ~ = 3624.968 - 3625.00 = -0.032 ft 

A Lat = ^ Lat - (F 2 - Y{) = -302.128 - (-302.00) = -0.128 ft (8.17) 
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TABLE 8.6 Computed Latitudes and Departures 


Course 

Latitude (ft) 

Departure (ft) 

1A 

-1022.007 

-314.014 

AB 

107.976 

926.993 

BC 

-262.022 

776.989 

CD 

747.973 

968.025 

D2 

125.952 

1266.975 


£ = -302.128 

£ = 3624.968 


In Equation (8.17), A Dep represents the misclosure in departure and I\Lat 
represents the misclosure in latitude. The linear misclosure for the traverse is 

LC = VAla? 2 + A Dep 2 = V(-0.128) 2 + (-0.032) 2 = 0.132 ft (8.18) 


Estimated Misclosure for the Traverse: Following procedures similar to those 
described earlier for polygon traverses, the expected misclosure in this link tra¬ 
verse can be estimated. The Jacobian matrix of the partial derivative for the 
latitude and departure with respect to distance and angle observations is 


A = 


cos A: xa — \A sin Az a 
sin Az ia IA cos Az ia 


0 0 
0 0 


0 0 

0 0 

cos Az ab -AB sin Az ab 
sin Az ab AB cos Az ab 


0 

0 

0 

0 


0 

0 

0 

0 


0 0 0 0 
0 0 0 0 


cos Az d2 -D2 sin Az m 
sin Az m 7)2 cos Az D2 

(8.19) 


Similarly, the corresponding covariance matrix E in Equation (6.16) has the 
form 



0 0 0 0 
0 0 0 0 

0 0 0 0 



( 8 . 20 ) 
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Substituting the appropriate numerical values into Equations (8.19) and 
(8.20) and applying Equation (6.16), the covariance matrix is 


x 


Lat, Dep 


0.000446 -0.000016 0 0000000 

-0.000016 0.000492 0 0000000 

0 0 0.000864 -0.000054 0 0 0 0 0 0 

0 0 -0.000054 0.000406 0 0 0 0 0 0 

0 0 0 0 0.00107 0.00023 0 0 0 0 

0 0 0 0 0.00023 0.00048 0 0 0 0 

0 0 0 0 0 0 0.00234 -0.00147 0 0 

0 0 0 0 0 0 -0.00147 0.00157 0 0 

0 0 0 00000 0.00453 -0.00041 

0 0 0 00000 -0.00041 0.00048 


To estimate the error in the traverse misclosure, Equation (6.16) must be 
applied to Equation (8.18). As was the case for closed polygon traverse, the 
terms of the Jacobian matrix are independent of the course for which they are 
determined, and thus, the Jacobian matrix has the form 

. _ (A Lat ADep ALat A Dep ALat ADep~\ 

~ I LC LC LC LC ' LC LC ' ’ 

Following procedures similar to those used in Example 8.2, the estimated 
error in the misclosure of the link traverse is 

Y = A\ A t = [0.00806] 

i-iLC i—t Lat, Dep L J 


From these results and using a t value from Table D.3 for 3 degrees of freedom, 
the estimated linear misclosure error for a 95% level of confidence is 

a 95% = 3.183\/0.00806 = ±0.29 ft 

Because the actual misclosure of 0.13 ft is within the range of values that are 
statistically equal to zero at the 95% level (±0.29 ft), there is no reason to believe 
that the traverse observations contain any blunders. Again, this test does not 
remove the possibility of a Type II error occurring. 


This example leads to an interesting discussion. When using traditional 
methods of adjusting link traverse data, such as the compass rule, the control 
is assumed to be perfect. However, since control coordinates are themselves 
derived from observations, they contain errors that are not accounted for 
in these computations. This fact is apparent in Equation (8.21) where the 
coordinate values are assumed to have no error and thus are not represented. 
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These equations can easily be modified to consider the control errors, but this 
is left as an exercise for the student. 

One of the principal advantages of the least squares adjustment method is 
that it allows application of varying weights to the observations, and control 
can be included in the adjustment with appropriate weights. A full discussion 
of this subject is presented in Section 21.7. 


8.6 SOFTWARE 

The computations in this chapter can be challenging or tedious at best to 
perform using a calculator. Thus, it is recommended that these computations 
be programmed in the software. On the companion website for this book, 
an Excel® spreadsheet (Chapter 8.xls) for Examples 8.2 and 8.3 is available 
for study. Programming allows for an easier and more reliable method of 
developing the required matrices. Once the initial matrices are computed, they 
can be manipulated in software such as MATRIX, which is on the companion 
website, or in the spreadsheet itself. 

A spreadsheet often provides routines to manipulate the matrices. In Excel®, 
matrices can be multiplied using the MMULTQ function. Similarly, matrices 
can be transposed using the TRANSPOSE() function. These functions are 
demonstrated in the spreadsheet CHAPTER 8.xls. To simplify the selection 
of the matrices, the block of cells for each matrix can be “named.” The help hie 
that accompanies Excel® discusses how to name cells or groups of cells and 
use the matrix functions. 

For those who wish to develop a more robust program, a higher-level pro¬ 
gramming language or Mathcad can be used. ADJUST demonstrates this in 
its traverse computations option. The dialog box for this option is shown in 
Figure 8.4, where a polygon traverse with angles is selected. At the bottom of 
the box is the option to compute the estimated errors in the traverse. Select¬ 
ing this option informs the software to not adjust the angles in the traverse, 
but rather, to use the entered distance and angle uncertainties to compute the 



FIGURE 8.4 Traverse computations option dialog box. 
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Example 8.2 
5 1 

000 0.0 
1435.67 110 24 40 
856.94 87 36 14 
1125.66 125 47 27 
1054.54 99 57 02 
756.35 116 14 56 
10000.00 5000.00 

FIGURE 8.5 ADJUST data file for Example 8.2. 


misclosures in both the angles and the traverse. Figure 8.5 depicts the file used 
in computing the estimated errors for Example 8.2. Notice that with a polygon 
traverse there is no error given for the initial azimuth of 0°00'00", and that the 
estimated errors in the distances and angles follow the observations for each 
course of the traverse. The help file that accompanies ADJUST describes the 
format of this file. 


8.7 CONCLUSIONS 

This chapter discussed the propagation of observational errors through 
traverse computations. Error propagation is a powerful tool for the surveyor, 
enabling an answer to be obtained for the question, “What is an acceptable 
traverse misclosure?” This is an example of surveying engineering. Surveyors 
are constantly designing measurement systems and checking their results 
against personal or legal standards. The subjects of error propagation and 
detection of observational blunders are discussed further in later chapters. 


PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

8.1 Which of the following are direct (independent) or indirect (dependent) 
observations? 

*(a) Angles 

(b) Latitudes and departures 

(c) Coordinates 

8.2 Discuss why latitudes and departures are considered correlated 
observations. 
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*8.3 Given a course with an azimuth of 78°16 / 08" with an estimated error 
of ±5" and a distance of 485.32 ft with an estimated error of ±0.018 ft, 
what are: 

(a) the latitude and departure? 

(b) the estimated errors in the latitude and departure? 

8.4 Same as Problem 8.3, except the azimuth is 328°54'16" ±11 .4" and the 
distance is 402.153 ± 0.005 m. 

8.5 Same as Problem 8.3, except the azimuth is 40°03'57" ± 3.3" and the 
distance is 1254.98 ± 0.013 ft. 

8.6 Same as Problem 8.3, except the azimuth is 88°33'44" ± 15.4" and the 
distance is 202.408 m ± 3.7 mm. 

8.7 Same as Problem 8.3, except the azimuth is 44°06 / 12" ± 9.8" and the 
distance is 156.022 m ± 3.2 mm. 

*8.8 A polygon traverse has the following angle measurements and related 
standard deviations. Each angle was observed twice (ID and 1R). Do 
the angles meet acceptable closure limits at a 95% level of confidence? 


Backsight 

Occupied 

Foresight 

Angle 

S(") 

A 

B 

C 

98°06'59" 

±2.8 

B 

C 

D 

85°56'57" 

±2.6 

C 

D 

A 

92° 3 3'50" 

±3.0 

D 

A 

B 

83°22'19" 

±3.2 


8.9 Same as Problem 8.8, except the angles were measured four times 
(2D and 2R) with the following observations. 


Backsight 

Occupied 

Foresight 

Angle 

so 

A 

B 

C 

82°42'10" 

±5.6 

B 

C 

D 

68°43'20" 

±5.3 

C 

D 

A 

93°03'30" 

±4.4 

D 

A 

B 

115°31'15" 

±4.8 


*8.10 Given an initial azimuth for course AB of 345° 16'29" with an estimated 
error of ±4.5", what are the azimuths and their estimated standard 
errors for the remaining three courses of Problem 8.8? 

8.11 Same as Problem 8.10, except for Problem 8.9. 
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8.12 Using the distances listed in the following table and the data from 
Problems 8.8 and 8.10, compute: 

(a) the misclosure of the traverse. 

*(b) the estimated misclosure error. 

(c) the 95% error in the traverse misclosure. 


From 

To 

Distance (ft) 

S{ ft) 

A 

B 

247.86 

±0.012 

B 

C 

302.49 

±0.012 

C 

D 

254.32 

±0.012 

D 

A 

319.60 

±0.012 


8.13 Given the traverse misclosures in Problem 8.12, does the traverse meet 
acceptable closure limits at a 95% level of confidence? Justify your 
answer statistically. 

8.14 Using the distances listed in the following table and the data from 
Problems 8.9 and 8.11, compute: 

(a) the misclosure of the traverse. 

*(b) the estimated misclosure error. 

(c) the 95% error in the traverse misclosure. 

(d) Given the traverse misclosures, does the traverse meet acceptable 
closure limits at a 95% level of confidence? Justify your answer 
statistically. 


From 

To 

Distance (ft) 

S{ ft) 

A 

B 

256.69 

±0.012 

B 

C 

303.45 

±0.012 

C 

D 

326.99 

±0.012 

D 

A 

160.17 

±0.012 


8.15 Using the data for the link traverse listed below, compute: 

(a) the angular misclosure and its estimated error. 

(b) the misclosure of the traverse. 

(c) the estimated misclosure error. 

(d) the 95% error in the traverse misclosure. 
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Distance Observations 

Angle Observations 


From 

To Distance (m) S (m) BS Occ FS 

Angle S’ (") 

W 

X 

Y 

X 180.395 

Y 146.622 

Z 251.526 

±0.005 Mk\ W X 

±0.005 W X Y 

±0.006 X Y Z 

157°39'42" ±3.6 
96°27T1" ±3.8 
172°52'34" ±3.7 



Y Z Mk2 

185°53'49" ±3.1 

Control Azimuths 

Control Stations 


From 

To Azimuth 

S (") Station Northing (m) 

i Easting (m) 

M/cl 

Z 

W 345°57'50" 
Mk2 58°51'09" 

±9" W 5,000.000 

±8" Z 5079.412 

10,000.000 

10,434.819 

8.16 

Does the link traverse of Problem 8.15 have acceptable traverse misclo- 
sure at a 95% level of confidence? Justify your answer statistically. 

8.17 

Same as Problem 8.15, using the following data. 


Distance Observations 

Angle Observations 


From 

To Distance (ft) 

S (ft) BS Occ FS 

Angle S (") 

W 

X 

Y 

X 223.59 

Y 854.40 

Z 460.95 

±0.012 MAT W X 

±0.013 W X Y 

±0.012 X Y Z 

171°52'06" ±5.5 

137°07'03" ±5.9 

290°02'35" ±3.4 



Y Z Mk2 

77°44'55" ±4.8 

Control Azimuths 

Control Stations 


From 

To Azimuth 

S (") Station Northing (ft) Easting (ft) 

MAT 

Z 

W 251°33'54" 
Mk2 28°21'00" 

±5.0" W 1000.00 

±3.0" Z 1850.00 

1000.00 

1600.00 


8.18 Does the link traverse of Problem 8.17 have acceptable traverse misclo- 
sure at a 95% level of confidence? Justify your answer statistically. 

8.19 Repeat Problem 8.15 with data and results from Problems 7.13 and 
7.20. Assume the azimuth of AB is 24°02 / 16" ± 6" and the xy coordi¬ 
nates at station A are (10,000.00, 5,000.00) in units of feet. 

8.20 A survey produces the following set of data. The angles were obtained 
from the average of four measurements (two face left and two face right) 
made with a total station. The estimated uncertainties in the observa¬ 
tions are: 

ff iSO = ±2", a t = ±0.005 ft, a, = ±0.003 ft 
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The EDM instrument has a specified accuracy of ± (3 mm + 3 ppm). 


Distance Observations 


From 

To 

Distance (ft) 

1 

2 

999.99 

2 

3 

801.55 

3 

4 

1680.03 

4 

5 

1264.92 

5 

1 

1878.82 


Control Azimuths 


From 

To 

Azimuth 

<y(") 

1 

2 

216°52T1" 

±3 


Angle Observations 


BS 

Occ 

FS 

Angle 

5 

1 

2 

19U40T2" 

1 

2 

3 

56°42'22" 

2 

3 

4 

122° 5710" 

3 

4 

5 

125°02'H" 

4 

5 

1 

43°38T0" 

Control Stations 

Station 

Easting (ft) 

Northing (ft) 

1 

1000.00 

1000.00 


Compute: 

(a) the estimated errors in angles and distances. 

(b) the angular misclosure and its 95% probable error. 

(c) the misclosure of the traverse. 

*(d) the estimated misclosure error and its 95% value. 

(e) Did the traverse meet acceptable closures? Justify your response 
statistically. 

8.21 Develop new matrices for the link traverse of Example 8.3 that consid¬ 
ers the errors in the control. 

8.22 Show that Equation (8.6) is valid for azimuth computations going 
clockwise around a traverse. 


PROGRAMMING PROBLEMS 

8.23 Develop a computational package that will compute the course 
azimuths and their estimated errors, given an initial azimuth and 
measured angles. Use this package to answer Problem 8.9. 

8.24 Develop a computational package will compute estimated traverse 
misclosure error, given course azimuths, distances, and their estimated 
errors. Use this package to answer Problem 8.10. 














CHAPTER 9 


ERROR PROPAGATION IN ELEVATION 
DETERMINATION 


9.1 INTRODUCTION 

Differential and trigonometric leveling are the two most commonly employed 
methods for determining elevation differences between stations. Both of these 
methods are subject to systematic and random errors. The primary systematic 
errors include Earth curvature, atmospheric refraction, and instrument malad¬ 
justment. The effects of these systematic errors can be minimized by following 
proper field procedures, or they can be modeled and corrected computationally. 
The random errors in differential and trigonometric leveling occur in instru¬ 
ment leveling, distance observations, and reading graduated scales. These must 
be treated according to the theory of random errors. 

9.2 SYSTEMATIC ERRORS IN DIFFERENTIAL LEVELING 

During the differential leveling process, sight distances are held short, 
and equal, to minimize the effects of systematic errors. Still, it should always be 
assumed that these errors are present in differential leveling observations, and 
thus corrective field procedures, described in this section, should be followed 
to minimize their effects. 

9.2.1 Collimation Error 

Collimation error occurs when the line of sight of an instrument is not truly 
horizontal and is minimized by keeping sight distances short and balanced. 


Adjustment Computations: Spatial Data Analysis, Sixth Edition. Charles D. Ghilani. 
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Figure 9.1 shows the effects of a collimation error. For an individual setup, the 
resulting error in an elevation difference due to collimation is 

e c = D x a - D 2 a (9.1) 

where e c is the error in elevation due to the presence of a collimation error, 
D x and D 2 , the distances to the backsight and foresight rods, respectively, and a 
the amount of collimation error present at the time of the observation expressed 
in radian units. Applying Equation (9.1), the collimation error for a line of 
levels can be expressed as 


e c — a\(D\ — D 2 ) + (F >3 — Z) 4 ) + • • • + (D n _ l — D n )] (9.2) 

where D x , D 2 ,..., D n _ x are the backsight distances, and D 2 , Z) 4 ,_ D n the 

foresight distances. If the backsight and foresight distances are grouped in 
Equation (9.2), then 

e c = a (Til ®bs ~ y, Dfs ) (9-3) 

The collimation error determined from Equation (9.3) is treated as a correc¬ 
tion, and thus subtracted from the observed elevation difference to obtain the 
corrected value. 

Example 9.1 A level having a collimation error of 0.04 mm/m is used on a level 
line where the backsight distances sum to 863 m and the foresight distances sum 
to 932 m. If the observed elevation difference for the line is 22.865 m, what is 
the corrected elevation difference? 

SOLUTION Using Equation (9.3), the error due to collimation is 


e c = 0.00004(863 - 932) m = -0.00276 m 
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Thus, the corrected elevation difference is 

22.865 - (-0.00276) = 22.868m 


9.2.2 Earth Curvature and Refraction 

As the line of sight extends from an instrument, the level surface curves down 
and away. This condition always causes rod readings to be too high. Similarly, 
as the line of sight extends from the instrument, refraction bends it toward the 
surface, causing readings to be too low. The combined effect of Earth curvature 
and refraction on an individual sight always causes a rod reading to be too high 
by an amount approximated as 



where h CR is the error in the rod reading (in feet or meters), CR is 0.0675 
when D is in units of meters or 0.0206 when D is in units of feet, and D is 
the individual sight distance. 

The effect of this error on a single elevation difference is minimized by 
keeping backsight and foresight distances short and equal. For unequal sight 
distances, the resulting error is expressed as 


e CR - CR 


Pi 

1000 


2 

- CR 



(9.5) 


where e CR is the error due to Earth curvature and refraction on a single 
elevation difference. Factoring common terms in Equation (9.5) yields 


e CR ~ 


- D\) 

1000 2 1 2 


(9.6) 


The curvature and refraction error computed from Equation (9.6) is treated 
as a correction, and thus subtracted from the observed elevation difference to 
get the corrected value. It is important to note that and D 2 in Equation (9.6) 
are the individual backsight and foresight distances, respectively, that occur in a 
line of levels. Since these terms are squared, each individual sight distance must 
be treated separately. That is, substituting the sum of the backsight and fore¬ 
sight distances into Equation (9.6) will yield incorrect results. These distances 
must be squared before they are summed. 


Example 9.2 An elevation difference between two stations on a hillside is 
determined to be 1.256 m. What would be the error in the elevation difference 
and the corrected elevation difference if the backsight distance were 100 m and 
the foresight distance 20 m only? 
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SOLUTION 
CR = 0.0675 


Substituting the distances into Equation (9.6) and using 

= OM^(ioo 2 - 20 2 ) = 0.0006 m 
1000 2 


From this, the corrected elevation difference is 


Ah = 1.256 - 0.0006 = 1.255 m 


For a line of differential leveling, the combined effect of this error is 

CC * = lS (jD ' _jD ' +jD '“^ + (9 ' 7) 

Regrouping backsight and foresight distances, Equation (9.7) becomes 

= >L-2>h) < 9 - 8 > 

The error due to refraction caused by the vertical gradient of temperature 
can be large when sight lines are allowed to pass through the lower layers of 
the atmosphere. Since observing the temperature gradient along the sight line 
would be cost prohibitive, a field procedure is generally adopted that requires 
all sight lines to be at least 0.5 m above the ground. This requirement eliminates 
the lower layers of the atmosphere where refraction is difficult to model. 

9.2.3 Combined Effects of Systematic Errors on Elevation Differences 

With reference to Figure 9.1, and by combining Equations (9.1) and (9.5), a 
corrected elevation difference, Ah, for one instrument setup is 

Ah = (rj - r 7 ) - (D l a - Z) 7 a)-^^(Dj - D\) (9.9a) 

1000“ 

where r, is the backsight rod reading, r 2 is the foresight rod reading, and the 
other terms are as defined previously. For a line of levels, the corrected elevation 
difference is 

Ah = X r BS - Z r PS - « (Z °BS - X D *s) ~ ^2 (Z D BS ~ Z D Fs) 

(9.9b) 

9.3 RANDOM ERRORS IN DIFFERENTIAL LEVELING 

Differential leveling is subject to several sources of random errors. Included 
are errors in leveling the instrument and in reading the rod. The sizes of these 
errors are affected by atmospheric conditions, the quality of the optics of the 
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telescope, the sensitivity of the level bubble or compensator, and the graduation 
scale on the rods. These errors are discussed below. 

9.3.1 Reading Errors 

The estimated error in rod readings is usually expressed as a ratio of the 
estimated standard error in the rod reading per unit sight distance length. For 
example, if an observer’s ability to read a rod is within ±0.005 ft per 100 ft, 
then <j rjD is ±0.005/100 = ±0.00005 ft/ft. Using this, rod reading errors for any 
individual sight distance D can be estimated as 


(9.10) 


°V - Do,./ D 


where a rjD is the estimated error in the rod reading per unit length of sight 
distance and D the length of the sight distance. 

9.3.2 Instrument Leveling Errors 

The estimated error in leveling for an automatic compensator or level vial is 
generally given in the technical data for each instrument. For precise levels, this 
information is usually listed in arc seconds or as an estimated elevation error 
for a given distance. As an example, the estimated error may be listed as ±1.5 
mm/km, which corresponds to ±(1.5/1,000,000)/? = ±0.3". A precise level has 
a compensator accuracy or setting accuracy between ±0.1" and ±0.2" usually, 
while for a less precise level the value may be as high as ±10". 

9.3.3 Rod Plumbing Error 

While a level rod that is held nonvertical always causes the reading to be too 
high, this error will appear random in a leveling network due to its presence in 
all backsight and foresight distances of the network. Thus, the rod plumbing 
error should be modeled when computing the standard error in an elevation 
difference. With reference to Figure 9.2 for any rod reading, the rod plumbing 
error is approximated as 



(9.11) 


where d is the linear amount that the rod is out of plumb at the location of the 
rod reading, r. The size of d is dependent on the rod level bubble centering error 
and the reading location. If the rod bubble is out of level by /?, then d is 


d = r sin /? 


(9.12) 


Substituting Equation (9.12) into (9.11) gives 


e L s = ^sin 2 /? 


(9.13) 
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Example 9.3 Assume that a rod level bubble is within ±5' of level and the rod 
reading is at 4 m. What is the estimated error in the rod reading? 


SOLUTION 


e LS 


= ^sin 2 5 / = 0.004 mm 
2 


Since the rod plumbing error occurs on every sighting, backsight errors will 
tend to cancel foresight errors. With precise leveling techniques, the combined 
effect of this error can be written as 

^ Usin 2 /? r 2 sin 2 /? ^ | ^ r 3 siir/? r 4 sin 2 /? ^ | J4) 

Grouping like terms in Equation (9.14) yields 

1 9 

e = -sin j){r x - r 2 + r 3 - r A + • • •) (9.15) 

Recognizing that the quantity in parentheses in Equation (9.15) is the elevation 
difference for the leveling line yields 

A Elev . 2 0 {n i£\ 

e LS = —2—'P ( 9 - 16 ) 

Example 9.4 If a level rod is maintained to within ±5' of level, and the eleva¬ 
tion difference is 22.865 m, the estimated error in the final elevation is 

22.865 . 2 ci n m 

-sin 5 = 0.02 mm 

2 


e LS ~ 
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The rod plumbing error can be practically eliminated by carefully centering 
the bubble of a well-adjusted rod level. It is generally small, as the example 
illustrates, and thus will be ignored in subsequent computations. 


9.3.4 Estimated Errors in Differential Leveling 

From the preceding discussion, the major random error sources in differential 
leveling are caused by random errors in rod readings and instrument level¬ 
ing. Furthermore, in Equation (9.9a), the collimation error is considered to be 
systematic and is effectively negated by balancing the backsight and foresight 
distances. Flowever, no matter what method is used to observe the lengths of 
the sight distances, some random error in these lengths will be present. This 
causes random errors in the elevation differences due to the effects of Earth 
curvature, refraction, and instrumental collimation errors. Equation (6.16) can 
be applied to Equation (9.9a) to model the effects of the random errors in rod 
readings, leveling, and sighting lengths. The following partial derivatives are 
needed: 


dAh _ dAh _ i dAh 
dr x dr 2 da x 

dAh _ ( CR{D X )\ 

dD~ x ~~ \ a + 500,000 ) 

By substituting Equations (9.17) into (6.16) with their corresponding esti¬ 
mated standard errors and dropping the negative signs, the standard error in a 
single elevation difference can be estimated as 


-D, 

da 2 

dAh _ 
dD 2 


-D, 


CR(D 2 )\ 

OL + - I 

500,000 / 


(9.17) 


(D x a r / D ) + {D 2 G r / D Y + (D x (j aX )- + ( D 2 a a2 ) 2 


°A/i - 


[/ CR(D X )\ 


2 

\( , CR(D 2 )\ 


+ 

V + 500,000 ) 

°Dl 

+ 

\ a+ 500,000 j am 


where a r/D is the estimated error in a rod reading, er al and a a2 the estimated 
collimation errors in the backsight and foresight, respectively, and a m and a D2 
are the estimated errors in the sight lengths, D x , and D 2 , respectively. 

In normal differential leveling procedures, D x = D 2 = D. Also, the estimated 
standard errors in the sight distances are equal, = a D2 — n D . Furthermore, 
the estimated collimation error for the backsight and foresight can be assumed 
equal, a al = o a2 = o a . Thus, Equation (9.18) simplifies to 


"M = ^ (<7^ + + 2»j(« + )" 


(9.19) 
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Equation (9.19) is appropriate for a single elevation difference when the sight 
distances are approximately equal. In general, if sight distances are kept equal 
for N instrument setups, the total estimated error in an elevation difference is 


(9 - 201 

Since the estimated error in the elevation difference due to Earth curvature 
and refraction, and collimation error, a, are typically small, the last term can be 
ignored, which will be demonstrated in Example 9.5. Thus, the final equation 
for the estimated standard error in differential leveling is 



Example 9.5 A level line is run from bench mark A to bench mark B. The esti¬ 
mated standard error in rod readings is ±0.01 mm/m. The instrument is within 
±2.0" of level. A collimation test shows that the instrument is within 4 mm per 
100 m. Fifty-meter sight distances are within ±2 m. The total line length from A 
to B is 1000 m. What is the estimated error in the elevation difference between 
A and B1 If A had an elevation of 212.345 ± 0.005 m, what is the estimated 
error in the computed elevation of B1 

SOLUTION The total number of setups in this problem is 1000/[(2)(50)] = 
10 setups. Substituting the appropriate values into Equation (8.20) yields 


°A/! 


"W 


2(10)50 2 


/ 0.01 \ 
V1000/ 


+ 


2 . 0 " 


+ 2 ( 10 ) 2 2 


0.004 0.0675(50) \ 


100 


+ 


500,000 




V0.0031 2 + 0.0004 2 = 0.0031 m = ±3.1 mm 


From an analysis of the individual error components in the previous 
equation, it is seen that the error caused by the error in the sight distances is 
negligible for all but the most precise leveling. Thus, like the error due to rod 
bubble centering, this error can be ignored in all but the most precise work. 
Thus, the simpler Equation (9.21) is used to solve the problem 



= V0.0031 2 = ±0.0031 m = ±3.1 mm 
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The estimated error in the elevation of B is found by applying Equation 
(6.18) as 


®Elev B 


V^ + ^v = ^ 52 + 3 - 12 = ± 5 - 9 mm 


9.4 ERROR PROPAGATION IN TRIGONOMETRIC LEVELING 

^3 With the introduction of total station instruments, it is becoming 
increasingly convenient to observe elevation differences using trigonometric 
methods. However in this procedure, because sight distances are not balanced 
typically, it is important that the systematic effects of Earth curvature and 
refraction, and inclination in the instrument’s line of sight (collimation error) 
be removed. From Figure 9.3, the corrected elevation difference, Ah, between 
two points is 

A li = hi + S sin a + h CR - hr (9.22) 

Equation (9.22) for zenith angle reading instruments is 

Ah = hi + S cos z + h CR — hr (9.23) 

where hi is the instrument height above ground, S the slope distance between 
the two points, a the altitude angle between the instrument and the prism, 
z the zenith angle between the instrument and the prism, h CR the Earth curva¬ 
ture and refraction correction given in Equation (9.4), and hr the rod reading. 
Substituting the curvature and refraction formula into Equation (9.23) yields 

A/z = /h + Scosz+C^^^ -hr (9.24) 

In developing an error propagation formula for Equation (9.24), not only 
must errors relating to the height of instrument and prism be considered, 
but errors in leveling, pointing, reading, and slope distances as discussed in 
Chapter 6 must also be included. Applying Equation (6.16) to (9.24), the 
following partial derivatives apply: 

dAh _ j 

dhi 

dAh _ i 
dhr 

dAh CR (S) sin 2 z 

-= cos z H- 

dS 500,000 

dAh CR (S 2 ) sinzcosz 

~dz 


500,000 


- S sin z 
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S sin(v) 



FIGURE 9.3 Determination of elevation difference by trigonometric leveling. 


Entering the partial derivatives and the standard errors of the observations 
into Equation (6.16), the total error in trigonometric leveling is 



(9.25) 


a A/; - 



where z is the zenith angle, CR is 0.0675 if units of meters are used or 0.0206 
if units of feet are used, S the slope distance, and p is the seconds-to-radian 
conversion of 206,264.8"/rad. 

In Equation (9.25), errors from several sources make up the estimated error 
in the zenith angle. These include the operator’s ability to point and read the 
instrument, accuracy of the vertical compensator, or operator’s ability to center 
the vertical circle bubble, and sensitivity of the compensator or vertical cir¬ 
cle bubble. For best results, zenith angles should be observed using both faces 
of the instrument and an average taken. Using Equations (7.4) and (7.6), the 
estimated error in a zenith angle that is observed in both positions (face left 
and face right) with a theodolite is 



(9.26a) 


where a r is the error in reading the circle, a the error in pointing, a B the error 
in the vertical compensator or in leveling the vertical circle bubble, and n the 
number of face-left and face-right observations of the zenith angle. For digital 
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theodolites or total stations, the appropriate formula is 


< 7 - 




\ 


(9.26b) 


where a ISO is the ISO 17123-3 standard for the instrument and all other values 
are as above. 

Notice that if only a single zenith angle observation is made (i.e., it is 
observed only in face left), its estimated error is simply 

< 7 - = yj 07 + Gp + o 2 b (9.27a) 

For the total station, the estimated error for a single observation is 

= \] 2(j2 iso + (y2 B ( 9 - 27b ) 

Recall, the estimated error in the slope distance, S, is computed using 
Equation (6.36). 


Example 9.6 A total station instrument has a vertical compensator accurate 
to within ±0.3", a digital reading accuracy of ±5", and a distance accuracy of 
±(5 mm + 5 ppm). The observed slope distance is 1256.78 ft. It is estimated 
that the instrument is set to within ±0.005 ft of the station, and the target is 
set to within ±0.01 ft. The height of the instrument is 5.12 ± 0.01 ft, and the 
prism height is 6.72 ± 0.01 ft. The zenith angle is observed in only one position 
and recorded as 88°13 / 15 / '. What is the corrected elevation difference and its 
estimated error? 


SOLUTION Using Equation (9.24), the corrected elevation difference is 


Ah = 5.12 + 1256.78 cos ( 88 ° 13'15") + 0.0206 


1256.78 sin (88°13'15"> 
1000 


= 37.45 ft 


6.72 


With Equation (9.27b), the zenith angle error is estimated as a. = 

^2(5)2 + 0.3 2 = ±7.1". From Equation (7.38) and converting 5 mm to 0.0164 
ft, the estimated error in the distance is 




1 0.005 2 + 0.01 2 + 0.0164 2 + 


1 , 000,000 


1256.78 


± 0.021 ft 
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Substituting these values into Equation (9.25), the estimated error in the 
elevation difference is 



= Vo.Ol 2 + 0 . 01 2 + 0.00065 2 + 0.043 2 = ±0.045 ft 


Note in this example, that the estimated error in the elevation difference 
caused by the distance error is negligible (±0.00065 ft), whereas the error 
in the zenith angle is the largest (±0.043 ft). Furthermore, since the vertical 
angle is not observed with both faces of the instrument, it is possible that 
uncompensated systematic errors are present in the final computed value. 
For example, assume that a 10" indexing error existed on the vertical circle. 
If the observations are taken using both faces of the instrument, the effects of 
this error are removed. Flowever, by making only a face-left observation, the 
systematic error due to the vertical indexing error is 


1256.78 sin (10") = 0.061 ft 


The uncompensated systematic error in the final value is considerably larger 
than the estimated error for the observation. One should always account for 
systematic errors by using proper held procedures. Failure to do so can only 
lead to poor results. In trigonometric leveling, a minimum of a face-left and 
face-right reading should always be taken. However, a prudent surveyor will 
observe the elevation difference several times to provide redundant observa¬ 
tions as a check. 


PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

*9.1 A level with a collimation error of 0.00008 ft/ft is used in leveling a line 
that has a sum of 525 ft for the backsight distances and only 1632 ft 
for the foresight distances. If the observed elevation difference is 
-6.07 ft, what is the elevation difference corrected for the collimation 
error? 

9.2 Similar to Problem 9.1, except that the collimation error is 0.02 mm/m, 
sum of the backsight distances is 423 m, sum of the foresight distance 
is 1032 m, and the observed elevation difference is -15.018 m. 
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*9.3 To expedite going down a hill, the backsight distances were consistently 
held to 100 ft while the foresight distances were held to 250 ft. There 
were 46 setups. If the observed elevation difference was -283.98 ft, 
what is the elevation difference corrected for Earth curvature and 
refraction? 

9.4 Similar to Problem 9.3, except that the backsight distances are 10 m, 
the foresight distances are 30 m, there were 35 setups, and the elevation 
difference is -104.387 m. 

*9.5 How far from vertical must the top of an 8-ft level rod have to be to 
create an error of 0.005 ft with a reading at 5.00 ft? 

9.6 Similar to Problem 9.5, except for a reading at 12.00 ft on a 25-1't rod. 

9.7 Similar to Problem 9.5, except for a 1.0-mm error with a reading at 
1.200 m on a 4-m rod. 

*9.8 A line of three-wire differential levels goes from bench mark Rock 
to bench mark Train. The length of the line was determined to 
be 2400 m. The instrument had a stated compensator accuracy of 
±0.2". The instrument-rod combination had an estimated reading 
error of ±1.5 mm per km. The instrument is found have an inclined 
collimation error of 2.0 mm per km, so the sight distances were kept 
to approximately 30 ± 3 m. If the observed difference in elevation is 
-65.906 m, what is the estimated error in the final elevation difference? 

9.9 Same as Problem 9.8, except that the instrument is found to not contain 
any collimation error. 

9.10 If in Problem 9.8, bench mark Rock had a fixed elevation of 321.071 m 
and Train had a fixed elevation of 136.759 m, did the job meet accept¬ 
able closure limits at a 95% level of confidence? Justify your answer 
statistically. 

9.11 If in Problem 9.9, bench mark Rock had a fixed elevation of 163.807 m 
and Train had a fixed elevation of 97.900 m, did the job meet accept¬ 
able closure limits at a 95% level of confidence? Justify your answer 
statistically. 

9.12 Similar to Problem 9.9, except that the compensator accuracy is 
±2.0 mm/km and the estimated error in reading the rod is 3.0 mm per 
100 m. 

*9.13 An elevation must be established on a bench mark on an island that 
is 520.02 ft from the nearest bench mark on the lake’s shore. The sur¬ 
veyor decides to use a total station that has a stated distance measuring 
accuracy of ±(3 mm + 3 ppm), and a vertical compensator accurate to 
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within ±0.4". The height of instrument was 5.26 ft with an estimated 
error of ±0.02 ft. The prism height was 6.00 ft with an estimated error 
of ±0.02 ft. The single zenith angle is read as 96°07 / 34". The estimated 
errors in instrument and target centering are ±0.005 1't. If the elevation 
of the occupied bench mark is 85.57 ft, what is the corrected bench 
mark elevation on the island? (Assume that the instrument does not 
correct for Earth curvature and refraction.) 

9.14 In Problem 9.13, what is the estimated error in the computed bench 
mark elevation if the instrument has an ISO standard of ±3"? 

9.15 After completing the job in Problem 9.13, the surveyor discovered that 
the instrument had a vertical indexing error that caused the sight line 
to be inclined by 15". 

(a) How much error would be created in the elevation of the island 
bench mark if the indexing error were ignored? 

(b) What is the corrected elevation? 

9.16 A tilting level is used to run a set of precise levels to a construction 
project from bench mark DAM that had an elevation of 153.608 m. 
The line is run along a road that goes up a steep incline. To expedite 
the job, backsight distances are kept to 50 m ± 3 m while foresight 
distances are 20 m ± 3 m. The total length of differential levels is 2450 
m. The observed elevation difference is 52.609 m. What is the corrected 
project elevation, if the instrument has a sight line that inclines at the 
rate of 1.5 mm per 50 m? 

9.17 In Problem 9.16, the instrument’s level is centered to within ±0.3" for 
each sight and the rod is read to ±2.0 mm per 50 m. 

(a) What is the estimated error in the elevation difference? 

(b) What is the 95% error in the final established bench mark? 

9.18 An elevation must be established on a bench mark on a hill that is 
2594.034 m from the nearest bench mark below. The surveyor decides 
to use a total station that has a stated distance measuring accuracy of 
±(3 mm + 3 ppm), and a vertical compensator accurate to within ±0.3". 
The height of instrument was 1.68m with an estimated error of ±5 mm. 
The prism height was 2.000 m with an estimated error of ±1 mm. The 
single zenith angle is read as 85°26'06". The estimated errors in instru¬ 
ment and target centering are ±2 mm. If the elevation of the occupied 
bench mark is 106.579 m, what is the corrected bench mark elevation 
on the hill? (Assume that the instrument does not correct for Earth 
curvature and refraction.) 

9.19 In Problem 9.18, what is the estimated error in the computed bench 
mark elevation if the instrument has an ISO standard of ±2"? 
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9.20 After completing the job in Problem 9.18, the surveyor discovered that 
the instrument had a vertical indexing error that caused the sight line 
to be inclined by 10". What is the estimated error in the computed 
bench mark elevation? 

9.21 Which method of leveling presented in this chapter offers the most 
precision? Defend your answer statistically. 


PROGRAMMING PROBLEMS 

9.22 Create a computation package that will compute a corrected eleva¬ 
tion difference and its estimated error using the method of differential 
leveling. Use this package to solve Problem 9.16. 

9.23 Create a computation package that will compute a corrected elevation 
difference and its estimated error using the method of trigonometric 
leveling. Use this package to solve Problem 9.14. 


CHAPTER 10 


WEIGHTS OF OBSERVATIONS 


10.1 INTRODUCTION 

^3 When surveying data are collected, they usually must conform to a 
given set of geometric conditions, and when they do not, the observations are 
adjusted to force that geometric closure. For a set of uncorrelated observations, 
a measurement with a high precision, as indicated by a small variance, implies 
a good observation, and in the adjustment it should receive a relatively small 
portion of the overall correction. Conversely, a measurement with a lower 
precision as indicated by a larger variance implies an observation with a larger 
error, and thus it should receive a larger portion of the correction. 

The weight of an observation is a measure of an observation’s relative 
worth compared to other observations. Weights are used to control the sizes 
of corrections applied to observations in an adjustment. The more precise an 
observation is, the higher its weight should be; in other words, the smaller the 
variance, the higher the weight. From this analysis, it can be stated intuitively 
that weights are inversely proportional to variances. Thus, it also follows that 
correction sizes should be inversely proportional to weights. 

In situations where observations are correlated, weights are related to the 
inverse of the covariance matrix, £. As discussed in Chapter 6, the elements of 
this matrix are variances and covariances. Since weights are relative, variances 
and covariances are often replaced by cofactors. A cofactor is related to its 
covariance by the equation 

ciij =-1 (10.1) 

ff o 
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where q t j is the cofactor of the z/'th observation, Oy the covariance of the i/th 
observation, and the reference variance, a value that can be used for scaling. 
Equation (10.1) can be expressed in matrix notation as 

Q = -U (10.2) 

where Q is defined as the cofactor matrix. The structure and individual elements 
of the £ matrix are 


E = 


<7 V <T V v 

x i x l x 2 


G x r c, . 

X 1 x l x 2 A 2 A„ 


X 1 X n 
XnX„ 


2 

IT,. y (Ty. r <7 V 

L x n Xi x n x 2 x n 


From the discussion above, the weight matrix W is 


W=Q~'= ao 2 ^- 1 


(10.3) 


For uncorrelated observations, the covariances are equal to zero (i.e., all 
a XjX = 0) and the matrix is diagonal. Thus, Q is also a diagonal matrix with 
elements equal to tr 2 /tr 2 The inverse of a diagonal matrix is also a diagonal 
matrix, with its elements being the reciprocals of the original diagonals, and 
thus Equation (10.3) becomes 


W = 


- 4 - o 


o -4 


o -4 


_ _2y-1 

- <7 


(10.4) 


From Equation (10.4), any independent observation with variance equal 
to a 1 has a weight of 

w, = ^ (10.5) 

If the /th observation has a weight, w t = 1, then a 2 = 4 , or 4 = 1. 
Thus, <t 2 is often called the variance of an observation of unit weight or short¬ 
ened to the variance of unit weight, or simply unit variance. Its square root 
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is called the standard deviation of unit weight. If or is set equal to 1 in 
Equation (10.5), then 

w, = \ (10.6) 

Note in Equation (10.6), as earlier stated, the weight of an observation is 
inversely proportional to its variance. 

With correlated observations, it is possible to have a covariance matrix, 
2, and a cofactor matrix, Q, but not a weight matrix. This occurs when the 
cofactor matrix is singular, and thus an inverse for Q does not exist. Most 
situations in surveying involve uncorrelated observations. For the remainder 
of this chapter, only the uncorrelated case with variance of unit weight will be 
considered. 


10.2 WEIGHTED MEAN 

If two observations are taken of a quantity and the first is twice as good as the 
second, their relative worth can be expressed by giving the first observation a 
weight of 2 and the second a weight of 1. A simple adjustment involving these 
two observations would be to compute the mean value. In this calculation, the 
observation having the weight of 2 could be added twice, and the observation 
of weight 1 could be added once. As an illustration, suppose a distance is mea¬ 
sured with a tape to be 151.9 ft, and the same distance is measured with an 
EDM instrument as 152.5 ft. Assume that previous experience indicates that 
the electronically measured distance is twice as good as the taped distance, and 
accordingly, the taped distance is given a weight of 1 and the electronically mea¬ 
sured distance is given a weight of 2. Then one method of computing the mean 
from these observations is 

151.9 + 152.5+ 152.5 , , 

M =---= 152.3 

As an alternative, the calculation can be rewritten as 

- = 1(151.9) + 2(152,5) 3 

1+2 

Note that the weights of 1 and 2 were entered directly into the second com¬ 
putation and that the result of this calculation is the same as the first. Also note 
that the computed mean tends to be closer to the measured value having the 
higher weight (i.e., 152.3 is closer to 152.5 than it is to 151.9). A mean value 
computed from weighted observations is called the weighted mean. 

To develop a general expression for computing the weighted mean, suppose 
that we have m independent, uncorrelated observations (r,, z 2 , • ■ •, z m ) f° r a 
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quantity z, and each of these observations has standard deviation a. Then the 
mean of the observations is 


(=i 


m 


(10.7) 


If these m observations were now separated into two sets, one of size m a and 
the other m h such that m a + m b = m, the means for these two sets would be: 


(=i 


( 10 . 8 ) 


(=/«„+1 


Z h = 


m h 


(10.9) 


The mean z is found by combining the means of these two sets as 

m a m m a m 

t z ‘+ Z z > Z r <-+ z 


i=\ i=m„+\ 


m 


i= 1 i=m n +1 


m a + m b 


( 10 . 10 ) 


But from Equations (10.8) and (10.9), 

m a 

=u m a = X Z i 311(1 Z b m b = Z 
(=1 

Thus, 

- Za m a + =b m b 

Z = - 

m a + m h 


i=m n +\ 


( 10 . 11 ) 


( 10 . 12 ) 


Note the correspondence between Equation (10.12) and the second equation 
used to compute the weighted mean in our simple illustration given earlier. By 
intuitive comparison, it should be clear that m a and m h correspond to weights 
that could be symbolized as w a and w b , respectively. Thus, Equation (10.12) 
can be written as 


- WgZg + W b Z b 
w a + w b 


w 


z = 


(10.13) 
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Equation (10.13) is used in calculating the weighted mean for a group of 
uncorrelated observations having unequal weights. In Chapter 11 it will be 
shown that the weighted mean is the most probable value for a set of weighted 
observations. 

Example 10.1 As a simple example of computing a weighted mean using 
Equation (10.13), suppose that a distance d is measured three times with the 
following results: 92.61 with weight 3, 92.60 with weight 2, and 92.62 with 
weight 1. Calculate the weighted mean. 

- = 3(92.61) + 2(92.60) + 1(92.62) 

3 + 2 + 1 

Note that if weight had been neglected, the simple mean would have been 
92.610. 


10.3 RELATIONSHIP BETWEEN WEIGHTS AND STANDARD ERRORS 

By applying the special law of propagation of variances [Equation (6.16)] to 
Equation (10.8), the variance z a in Equation (10.8) is 


^ = (^V 2 +f-V 2 +-+( — 

■ d-\) \ dz 2) \ dz m 


(10.14) 


Substituting partial derivatives with respect to the observations into 
Equation (10.14) yields 


nr = 


1 y a 2 + (j_\ (7 2 + ... + (j_\ (T 2 


m. 


m. 


m, 


Thus, 


2 /I 

a-_ = m„ 


2 1 2 

a = —n 


m a J m a 
Using a similar procedure, the variance of z b is 


(10.15) 


2 _ 1 2 
or = —a 

z t> m h 


(10.16) 


In Equations (10.15) and (10.16), a is a constant and the weights of z a and 
z b were established as m a and m b , respectively, from Equation (10.13). Since the 
weights are relative, from Equations (10.15) and (10.16), 

1 a 1 

a = — and w b — — 

or or 


w, 


(10.17) 
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Conclusion: With uncorrelated observations, weights of the observations are 
inversely proportional to their variances. 


10.4 STATISTICS OF WEIGHTED OBSERVATIONS 
10.4.1 Standard Deviation 

By definition, an observation is said to have a weight w when its precision 
is equal to that of the mean of w observations of unit weight. Let er 0 be the 
standard error of an observation of weight 1, or unit weight. If y 1 , y 2 ,..., 
are observations having standard errors a x , o 2 ,..., o n and weights wq, vv 2 ,..., 
w n , then by Equation (10.5) 


ui = 




(10.18) 


In Section 2.7, the standard error for a group of observations of equal weight 
was defined as 

n 

1=1 
n 

Now, in the case where the observations are not equal in weight, the equation 
above becomes 



/ H’]£“ + W 2 £ 2 + ■ 


V 



n 




(10.19) 


When modified for the standard deviation in Equation (2.7), it is 


'wivl + w 2 v\ + • • • + w n v 2 n 


1-1 






1=1 


-1 


( 10 . 20 ) 


10.4.2 Standard Error of Weight 1/1/ and Standard Error 
of the Weighted Mean 

The relationship between standard error and standard error of weight w was 
given in Equation (10.18). Combining this with Equation (10.19) and dropping 
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the summation limits, equations for standard errors of weight w are obtained 
in terms of er 0 as follows 



Similarly, standard deviations of weight w can be expressed as 


( 10 . 21 ) 


Si = 


\ 


w x {n - 1)’ 


S 2 


A 


w 2 (n - 1) ’ 


..,S n 


\ 


Z ivy2 

w n (n ~ 1 ) 


( 10 . 22 ) 


Finally, the standard error of the weighted mean is calculated as 



and the standard deviation of the weighted mean is 


(10.23) 


wv 




w 


(10.24) 


10.5 WEIGHTS IN ANGLE OBSERVATIONS 


Suppose that the three angles a x , a 2 , and a 3 in a plane triangle are observed 
«!, n 2 , and n 3 times, respectively, with the same instrument under the same 
conditions. What are the relative weights of the angles? 

To analyze the relationship between weights and the number of times an 
angle is turned, let S be the standard deviation of a single angle observation. 
The means of the three angles are 


X “1 Z “2 

<*1 = -, OCn = -, a 3 = 

«! «2 


Z«3 

«3 
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The variances of the means, as obtained by applying Equation (6.16), are 


s 2 = Ls 2 s 2 = —S' 2 S 2 = —s 2 


a 2 


«2 


“3 


Again, since the weights of the observations are inversely proportional to 
the variances and relative, the weights of the three angles are 


w i = 


1 


S 2 


ns 


1 


a 2 


s 2 


ns 


1 


'a 3 


s 2 


In the above expressions, S is a constant term in each of the weights, and 
because weights are relative it can be dropped. Thus, the weights of the angles 
are nq = n x , w 2 = n 2 , and w 2 = n 2 . 

In summary, it has been shown that when all conditions in angle observation 
are equal except for the number of turnings, angle weights are proportional to 
the number of times the angles are turned. 


10.6 WEIGHTS IN DIFFERENTIAL LEVELING 

Suppose that for the leveling network shown in Figure 10.1, the lengths of the 
lines 1, 2, and 3 are 2, 3, and 4 miles, respectively. For these varying lengths of 
lines, it can be expected that the errors in their elevation differences will vary, 
and thus the weights assigned to the elevation differences should also be varied. 
What relative weights should be used for these lines? 

To analyze the relationship of weights and level lines lengths, recall from 
Equation (9.21) that the variance in A h is 

o\ h = D 2 [l N(a 2 / D + ff 2 )] (a) 

where D is the length of the individual sights, N the number of setups, a rlD the 
estimated error in a rod reading, and o a the estimated collimation error for 
each sight. Let /, be the length of the z'th course between bench marks; then 



FIGURE 10.1 Differential leveling network. 
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Substituting Equation ( b ) into Equation (a) yields 

°\h = l i D ^/l) + (C) 

Elowever, Z), <r,. /z >, and <7 a are constants, and thus by letting k = D(rf/ D + 
Equation (c) becomes 

o'!/, = id) 


For this example, it can be said that the weights are 


w, = 


l x k 


HS = 


Uk 


w, = 


Uk 


0 ) 


Now since k is a constant and weights are relative, Equation (e) can be sim¬ 
plified to 

1 1 1 
W’l = T tv 2 = - w 3 = - 


h 


In summary, it has been shown that weights of differential leveling lines are 
inversely proportional to their lengths, and since any course length is propor¬ 
tional to its number of setups, weights are also inversely proportional to the 
number of setups. 


10.7 PRACTICAL EXAMPLES 

Example 10.2 Suppose the angles in an equilateral triangle ABC were 
observed by the same operator using the same instrument, but the number 
of repetitions for each angle varied. The results were: A = 45°15 / 25", n = 4; 
B = 83°37'22", n = 8; and 51°07'39", n = 6. Adjust the angles. 

SOLUTION Weights are proportional to the number of repetitions, and cor¬ 
rections are made in inverse proportion to those weights. The sum of the three 
angles is 180°00 / 26", and thus the misclosure that must be adjusted is 26". 
The correction process is demonstrated in Table 10.1. 


TABLE 10.1 Adjustment of Example 10.2 


Angle 

«(Weight) 

Correction Factor 

Correction 

Corrected Angle 

A 

4 

(1/4)24= 6 

(6/13)26= 12" 

45° 15'13" 

B 

8 

(1/8)24= 3 

(3/13)26 = 06" 

83°37'16" 

C 

6 

(1/6)24= 4 

(4/13)26 = 08" 

51°07'31" 



£ = 13 

£ = 26" 

2 = 180°00'00" 
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Note that a multiplier of 24 was used for convenience to avoid fractions in 
computing correction factors. Because weights are relative, this did not alter 
the adjustment. Note, also, that two computational checks are secured in the 
above solution; the sum of the individual corrections totaled 26", and the sum 
of the corrected angles totaled 180°00'00". 


Example 10.3 In the leveling network of Figure 10.1, recall that the lengths 
of lines 1, 2, and 3 were 2, 3, and 4 miles, respectively. If the observed 
elevation differences in lines 1, 2, and 3 were +21.20 ft, +21.23 ft, and +21.29 
ft, respectively, find the weighted mean for the elevation difference, and 
the adjusted elevation of BMX. {Note: All level lines were run from BMA 
to BMX.) 


SOLUTION The weights of lines 1,2, and 3 are 1/2, 1/3, and 1/4, respectively. 
Again, since weights are relative, these weights can arbitrarily be multiplied by 
12 to obtain weights of 6, 4, and 3, respectively. Applying Equation (10.13), the 
weighted mean is 


mean AElev = 


6(21.20)+ 4(21.23)+ 3(21.29) 
6 + 4 + 3 


+21.23 


Thus, the elevation of BMX = 100.00 + 21.23 = 123.23 ft. Note that if the 
weights had been neglected, the simple average would have given a mean ele¬ 
vation difference of +21.24. 


Example 10.4 A distance is observed as 625.79 ft using a cloth tape and given 
weight of 1; it is measured again as 625.71 ft using a steel tape and assigned 
a weight of 2; and finally, it is measured a third time as 625.69 ft with an 
EDM instrument and given a weight of 4. Calculate the most probable 
value of the length (weighted mean), and find the standard deviation of the 
weighted mean. 


SOLUTION By Equation (10.13), the weighted mean is 
— 1(625.79)+ 2(623.71)+ 4(625.69) 


M = 


= 625.71 ft 


1 + 2 + 4 

By Equation (10.24), the standard deviation of the weighted mean is 




wv 


\ (n-\)'Y^w 


0.0080 

(2)7 


±0.024 ft 
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where 


v, = 625.71 - 625.79 = -0.08 
v 2 = 625.71 - 625.71 = 0.00 
v, = 625.71 - 625.69 = +0.02 


w l v 1 2 = l(-0.08) 2 = 0.0064 
w 2 v 2 2 = 2(0.00) 2 = 0.0000 
w 3 v 3 2 = 4(+0.02) 2 = 0.00 1 6 
Z wv 2 = 0.0080 


Example 10.5 In leveling from bench mark + to bench mark B. four different 
routes of varying length are taken. The data of Table 10.2 are obtained. (Note 
that the weights were computed as for computational convenience only.) 


TABLE 10.2 Route Data for Example 10.5 


Route 

Length (miles) 

AElev 

W 

1 

1 

+25.35 

18 

2 

2 

+25.41 

9 

3 

3 

+25.38 

6 

4 

6 

+25.30 

3 


Calculate the most probable elevation difference (weighted mean), the stan¬ 
dard deviation of unit weight, the standard deviation of the weighted mean, 
and the standard deviations of the weighted observations. 


SOLUTION By Equation (10.13), the weighted mean for elevation 
difference is 


— 18(25.35) + 9(25.41) + 6(25.38) + 3(25.30) 

18 + 9 + 6 + 3 


+25.366 ft 


Notice that the arithmetic mean for this set of observations is 25.335, but 
the weighted mean is 25.366. To find the standard deviations for the weighted 
observations, the data in Table 10.3 are first created. 


TABLE 10.3 Data for Standard Deviations 
in Example 10.5 


Route 

w 

V 

V 2 

wv 2 

1 

18 

+0.016 

0.0002 

0.0045 

2 

9 

-0.044 

0.002 

0.0171 

3 

6 

-0.014 

0.0002 

0.0012 

4 

3 

+0.066 

0.0043 

0.0130 
2>v 2 = 0.0361 
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By Equation (10.20), the standard deviation of unit weight is 

s 0 = /Mpr =±0 . llft 


By Equation (10.24), the standard deviation of the weighted mean is 


% = 


0.0361 

36(3) 


= ±0.018 ft 


By Equation (10.22), the standard deviations for the weighted observations are 
S) = a / = ±0.026 ft 


18(3) 

0.0361 

6(3) 


5, = ^ = ±0.037 ft 


±0.045 ft 


S 4 = 


9(3) 

0.0361 

3(3) 


±0.063 ft 


PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 

Appendix El. 

*10.1 An angle was measured as 56°15'00" using an engineer’s transit, and 
had a standard deviation of ±30". It was measured again using a repeat¬ 
ing optical theodolite as 56°14'44" with a standard deviation of ±10". 
This angle was measured a third time with a directional theodolite 
56°14'48" with a standard deviation of ±5". Calculate the weighted 
mean of the angle and its standard deviation. 

*10.2 What is the standard deviation in the weighted mean for Problem 10.1? 

10.3 A zenith angle was measured six times with both faces of a total station. 
The average direct reading is 86°34'31" with a standard deviation of 
±12.8". With the reverse face, it was observed as 273°25'12" with a 
standard deviation of ±8.8". What is the most probable value for the 
zenith angle in the direct face? 

10.4 Similar to Problem 10.3 except the angle was measured four times in 
both faces and the average of the direct readings was 92°26'40" ± 9.8" 
and the average of the reverse readings was 267°33'25" ± 12.6". 
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10.5 An angle was measured at four different times with the following 
results: 


Day 

Angle 

s (") 

1 

108°05'34" 

±6.2 

2 

108°05'36" 

±9.7 

3 

108°05'28" 

±4.8 

4 

108°05'26" 

±5.6 


What is the most probable value for the angle and the standard devia¬ 
tion in the mean? 

*10.6 A distance was measured by pacing as 155 ft with a standard deviation 
of ±5 ft. It was then observed as 153.69 ft with a steel tape having 
a standard deviation of ±0.05 ft. Finally, it was measured as 153.79 
ft with an EDM instrument with a standard deviation of ±0.02 ft. 
What is the most probable value for the distance and its standard 
deviation? 

10.7 A distance was measured by pacing as 267 ft with a standard deviation 
of ±2 ft. It was then measured as 268.94 ft with a steel tape and had a 
standard deviation of ±0.06 ft. Finally, it was measured as 268.99 ft 
with an EDM. The EDM instrument and reflector setup standard 
deviations were ±0.005 ft, and the manufacturer’s estimated standard 
deviation for the EDM instrument is ±(3 mm + 3 ppm). What is the 
most probable value for the distance and the standard deviation of the 
weighted mean? 

10.8 What is the computed standard deviation for each weighted observa¬ 
tion of Problem 10.5? 

10.9 During a construction project, the difference in elevation from the deck 
to the surface of the underpass is observed four times using differential 
leveling. The observations and the lengths of the lines are 


Route 

AElev (m) 

Length (m) 

1 

15.087 

149.708 

2 

15.095 

152.035 

3 

15.078 

138.694 

4 

15.084 

165.842 
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What is 

*(a) The weighted mean for the elevation difference? 

(b) Its standard deviation? 

(c) Standard deviation of the weighted mean? 

(d) Standard deviation for each weighted observations? 

10.10 An angle is observed on three different days with the following results. 


Day 

Observation 

so 

1 

28°26'54" 

±6.5 

2 

28°26'48" 

±4.3 

3 

28°26'52" 

±6.9 


What is the: 

(a) Weighted mean of the angle? 

(b) Standard deviation in the weighted mean? 

10.11 Three crews level to a bench mark following three different routes. The 
lengths of the routes and the observed differences in elevation are 


Route 

AElev (ft) 

Length (ft) 

1 

12.08 

3200 

2 

11.98 

4800 

3 

12.13 

3900 


What is the 

(a) Weighted mean for the difference in elevation? 

(b) Standard deviation for the weighted elevation difference? 

(c) Standard deviation for the elevation difference? 

10.12 Find the standard deviations for the weighted observations in 
Problem 10.11. 








CHAPTER 11 


PRINCIPLES OF LEAST SQUARES 


11.1 INTRODUCTION 

In surveying, observations must often satisfy established numerical 
relationships known as geometric constraints. As examples, in a closed-polygon 
traverse, horizontal angle and distance observations should conform to the 
geometric constraints given in Section 8.4, and in a differential leveling loop, 
the elevation differences should sum to given a quantity. However, because 
the geometric constraints rarely meet perfectly, an adjustment of the data is 
performed. 

As discussed in earlier chapters, errors in observations conform to the 
laws of probability; that is, they follow normal distribution theory. Thus, they 
should be adjusted in a manner that follows these mathematical laws. While 
the mean has been used extensively throughout history, the earliest works on 
least squares started in the late eighteenth century. Its earliest application 
was primarily for adjusting celestial observations. Laplace first investigated 
the subject and laid its foundation in 1774. The first published article on the 
subject, titled “Methode des Moindres Quarres” (Method of Least Squares), 
was written in 1805 by Legendre. However, it is well known that although 
Gauss did not publish until 1809, he developed and used the method exten¬ 
sively as a student at the University of Gottingen beginning in 1794, and thus 
is given credit for the development of the subject. In this chapter, equations 
for performing least squares adjustments are developed, and their uses are 
illustrated with several examples. 
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11.2 FUNDAMENTAL PRINCIPLE OF LEAST SQUARES 

To develop the principle of least squares, a specific case will be considered. Sup¬ 
pose there are n independent equally weighted measurements, z,, z 2 ,..., z„, 
of the same quantity z that has a most probable value denoted by M. By 
definition, 

M — Zj = Vj 
M — z 2 = v 2 

( 11 . 1 ) 


M z n v„ 

In Equation (11.1) the v’s are the residual errors. Note that residuals behave in 
a manner similar to errors, and thus they can be used interchangeably in the 
normal distribution function given by Equation (3.2). By substituting v for x, 
there results 

f x (v) = y = -J—e-^ 2 = Ke (11.2) 
g\2k 

where h = 1 lo\Jl and K = h/yfn. 

As discussed in Chapter 3, probabilities are represented by areas under the 
normal distribution curve. Thus, the individual probabilities for the occurrence 
of residuals v Is v 2 ,..., v„ are obtained by multiplying their respective ordinates 
y 2 ,..., y„ by some infinitesimally small increment of v, which is denoted 
as Av. The following probability statements result 

Pj = jjAv = Ae _/,2v i Av 
P 2 =y 2 Av = Ke h2v2 2 Av 

(11.3) 

P„ = y n Av = Ke-*< Av 

From Equation (3.1), the probability of the simultaneous occurrence of all the 
residuals v x through v n is the product of the individual probabilities, and thus 

P = (^e- /,2v ?Av) |fe' ,|2 ' 2 Avj • • • iyKe- 1 ' 2 ' 2 Av) (11.4) 

Simplifying Equation (11.4) yields 


P = K n { Av)' 1 e _/ ' 2 ( v i +v2+ " +v ») 


(11.5) 
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X 


FIGURE 11.1 Plot of e x . 


M is a quantity that is to be selected in such a way that it gives the greatest 
probability of occurrence; stated differently, the value of M that maximizes 
the value of P. In Equation (11.5), the values of K, h, and Av are all constants, 
and thus only the residuals can be modified by selecting different values for M. 
Figure 11.1 shows a plot of the e~ x versus x. From this plot it is readily seen 
that e~ x is maximized by minimizing x, and thus in relation to Equation (11.5), 
the probability P is maximized when the quantity (v^ + v, + • • • + vj t ) is 
minimized. In other words, to maximize P, the sum of the squared residuals 
must be minimized. Equation (11.6) expresses the principle of least squares. 


^ v 2 = (v, + v\ + • • • + vl) = minimum 


( 11 . 6 ) 


This condition states: “The most probable value (MPV) for a quantity 
obtained from repeated observations of equal weight is the value that renders 
the sum of the squared residuals a minimum.” From calculus, the minimum 
value of a function can be found by taking its first derivative and equating the 
resulting function with zero. That is, the condition stated in Equation (11.6) 
is enforced by taking the first derivative of the function with respect to 
the unknown variable M and setting the results equal to zero. Substituting 
Equation (11.1) into Equation (11.6) yields 


^v 2 ={M-z l ) 2 + (M-z 2 ) 2 + ---+{M-z n ) 2 (11.7) 


Taking the first derivative of Equation (11.7) with respect to M and setting the 
resulting equation equal to zero yields 



2 (M - z x ) (1) + 2 (M — z 2 ) (1) + ■ ■ ■ + 2 (M - z„) (1) = 0 


( 11 . 8 ) 


dM 
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Now dividing Equation (11.8) by 2 and simplifying yields 

M — z l + M — z 2 + ■ ■ ■ + M — z n = 0 

nM = z x + z 2 + ■ • -z n (11.9) 

M = " 1+ - 2 + --- + z " 
n 

In Equation (11.9) the quantity (z l + z 2 + ■ ■ ■z n ) /«is the mean of the observed 
values. This is proof that when a quantity has been observed independently 
several times, the MPV is the arithmetic mean. 

11.3 THE FUNDAMENTAL PRINCIPLE OF WEIGHTED 
LEAST SQUARES 

In Section 11.2, the fundamental principle of a least squares adjustment was 
developed for observations having equal or unit weights. The more general case 
of least squares adjustment assumes that the observations have varying degrees 
of precision and thus varying weights. 

Consider a set of measurements z u z 2 ,...,z n having relative weights 
w l ,w 2 ,...,w n and residuals v 1 ,v 2 ,...,v„. Denote the weighted MPV as M. 
As in Section 11.2, the residuals are related to the observations through 
Equations (11.1), and the total probability of their simultaneous occurrence is 
given by Equation (11.5). However, notice in Equation (11.2) that h 2 = 1 /2<r 2 , 
and since weights are inversely proportional to variances, they are directly 
proportional to h 2 . Thus, Equation (11.5) can be rewritten as 

P = K n (Av)"e-( WlV ? +M ’ 2V 2 + - +w ^) (11.10) 

To maximize P in Equation (11.10), the negative exponent must be minimized. 
To achieve this, the sum of the products of the weights times their respec¬ 
tive squared residuals must be minimized. This is the condition imposed in 
a weighted least-squares adjustment. The condition of weighted least-squares 
adjustment in equation form is 

Hq v 2 + w 2 v\ + • • • + w n v 2 = ^ vrv 2 minimum (11.11) 

Substituting the values for the residuals given in Equation (11.1) into 
Equation (11.11) yields 

wq (M - z x y + w 2 (M - z 2 ) 2 + ■ • • + w n (M - z n )~ -*■ minimum (11.12) 

The condition for a weighted least square adjustment is: The most proba¬ 
ble value for a quantity obtained from repeated observations having various 
weights is that value that renders the sum of the weight times their respective 
squared residual a minimum. 
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The minimum condition is imposed by differentiating Equation (11.12) with 
respect to M and setting the resultant equation equal to zero. This yields 

2u’i (M - Zj) (1) + 2w 2 (M — z 2 ) (1) + ■ ■ ■ + 2w„ (M - z„) (1) = 0 (11.13) 

Dividing Equation (11.13) by 2 and rearranging results in 

W| (M - Zj) + w 2 (M - z 2 ) + • • • + w n ( M - z„) = 0 (11.14a) 

Rearranging Equation (11.14a) yields 

uqz] + w 2 z 2 + • • • + w„z„ = h \M + w 2 M + • • • w„M (11 .146) 

Equation (11.146) can be written as ^ wz = ^ wM. Thus, 

V wz 

M=^~ (11.15) 

2j w 

Notice that Equation (11.15) is the same as Equation (10.13), which is the 
formula for computing the weighted mean. 


11.4 THE STOCHASTIC MODEL 

The determination of variances, and subsequently the weights of the observa¬ 
tions, is known as the stochastic model in a least squares adjustment. In Section 
11.3, the inclusion of weights in the adjustment was discussed. It is crucial to 
the adjustment to select a proper stochastic (weighting) model since, as was 
discussed in Section 10.1, the weight of an observation controls the amount 
of correction it receives during the adjustment. Elowever, development of the 
stochastic model is important to more than the weighted adjustments. When 
doing an unweighted adjustment, all observations are assumed to be of equal 
weight, and thus the stochastic model is created implicitly. The foundations for 
selecting a proper stochastic model in surveying were established in Chapters 7 
to 10. It will be shown in Chapter 21 that failure to select the stochastic model 
properly will also affect one’s ability to isolate blunders in observational sets. 


11.5 FUNCTIONAL MODEL 

A functional model in adjustment computations is an equation or set of 
equations/functions that represents or defines an adjustment condition. It 
must either be known or assumed. If the functional model represents the phys¬ 
ical situation adequately, the observational errors can be expected to conform 
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to the normal distribution curve. For example, a well-known functional model 
states that the sum of angles in a triangle is 180°. This model is adequate if 
the survey is limited to a small region. Flowever, when the survey covers very 
large areas, this model does not account for the systematic errors caused by 
curvature of the Earth. In this case, the functional model is inadequate and 
needs to be modified to include corrections for spherical excess. In traversing, 
the functional model of plane computations is suitable for smaller surveys, 
but if the extent of the survey becomes too large, again the model must be 
changed to account for the systematic errors caused by curvature of the 
Earth. This can be accomplished by transforming the observations into a 
plane mapping system such as the state plane coordinate system or by using 
geodetic observation equations. Needless to say, if the model does not fit the 
physical situation, an incorrect adjustment will result. The mathematics for 
the map projections used in state plane coordinates is covered in Appendix F. 
Chapter 23 discusses a three-dimensional geodetic model and the systematic 
errors that must be taken into account in a three-dimensional geodetic network 
adjustment. 

There are two basic forms for functional models: conditional and parametric 
adjustments. In the conditional adjustment, geometric conditions are enforced 
upon the observations and their residuals. Examples of conditional adjustment 
are: (1) the sum of the angles in a closed polygon is (n - 2)180°, where n is 
the number of sides in the polygon; (2) the latitudes and departures of a poly¬ 
gon traverse sum to zero; and (3) the sum of the angles in the horizon equal 
360°. A least squares adjustment example using condition equations is given in 
Section 11.13. 

When performing a parametric adjustment, observations are expressed in 
terms of unknown parameters that were never observed directly. For example, 
the well-known coordinate equations are used to model the observed angles, 
directions, and distances in a horizontal plane survey. The adjustment yields the 
most probable values for the coordinates (parameters), which, in turn, provide 
the most probable values for the adjusted observations. 

The choice of the functional model will determine which quantities or 
parameters are adjusted. A primary purpose of an adjustment is to ensure that 
all observations are used to find the most probable values for the unknowns 
in the model. In least squares adjustments, no matter if conditional or para¬ 
metric, the geometric checks at the end of the adjustment are satisfied and the 
same adjusted observations are obtained. In complicated networks, it is often 
difficult and time consuming to write equations to express all conditions that 
must be met for a conditional adjustment. Thus, this book will focus on the 
parametric adjustment, which generally leads to larger systems of equations 
but is straightforward in its development and solution and, as a result, is well 
suited to computers. 

The mathematical model for an adjustment is the combination of the 
stochastic model and functional model. Both the stochastic model and 
functional model must be correct if the adjustment is to yield the most 
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probable values. That is, it is just as important to use a correct stochastic model 
as it is to use a correct functional model. Improper weighting of observations 
will result in the unknown parameters being determined incorrectly. 


11.6 OBSERVATION EQUATIONS 

Equations that relate observed quantities to both observational residuals 
and independent, unknown parameters are called observation equations. One 
equation is written for each observation and for a unique set of unknowns. 
For a unique solution of unknowns, the number of equations must equal 
the number of unknowns. Usually, there are more observations (and hence 
equations) than unknowns, and this permits the determination of the most 
probable values for the unknowns based on the principle of least squares. 

11.6.1 Elementary Example of Observation Equation Adjustment 

As an example of a least squares adjustment by the observation equation 
method, consider the following three equations: 

(1) x + y = 3.0 

(2) 2x — y= 1.5 (11.16) 

(3) x — y — 0.2 

Equations (11.16) relate the two unknowns, x and y, to the observed quantities 
3.0, 1.5, and 0.2. One equation is redundant since the values for x and y can 
be obtained from any two of the three equations. For example, if Equations 
(1) and (2) are solved then x would equal 1.5 and y would equal 1.5, but if 
Equations (2) and (3) are solved then x would equal 1.3 and y would equal 
1.1, and if Equations (1) and (3) are solved then x would equal 1.6 and y would 
equal 1.4. Based on the inconsistency of these equations, the observations must 
contain errors. Therefore, new expressions, called observation equations, can be 
rewritten that include residuals. The resulting set of equations is 

(4) vj = x + j-3.0 

(5) v 2 = 2x-j> — 1.5 (11.17) 

(6) v 3 — x — y — 0.2 


Equations (11.17) relate the unknown parameters to the observations and their 
errors. Equations of this form are known as residual equations. Obviously, it is 
possible to select values of v,, v 2 , and v 3 that will yield the same values for 
x and y no matter which pair of equations are used. For example, to obtain 
consistencies through all of the equations, arbitrarily let Vj = 0, v 2 = 0, and 
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v 3 = -0.2. In this arbitrary solution, x would equal 1.5 and y would equal 
1.5, no matter which pair of equations is solved. This is a consistent solution; 
however, there are other values for the residuals (v’s) that will produce a smaller 
sum of squares, and thus the most probable values for the unknowns x and y. 

To find the least squares solution for x and y, the residual equations are 
squared and these squared expressions are added to give a function, f(x, y) 
that equals the £v 2 . Doing this for Equations (11.17) yields 

f (x,y) = ^ v 2 = (x + y - 3.0) 2 + (2x - y - 1.5 ) 2 + (x — y - 0.2) 2 (11.18) 

As discussed previously, to minimize a function, its derivatives must 
be set equal to zero. Thus, in Equation (11.18), the partial derivatives of 
Equation (11.18) with respect to each unknown must be taken, and set equal 
to zero. This leads to the two equations: 

^ ’'' ^ =2 {x + y — 3.0) + 2 (2x -y - 1.5)(2) + 2 (x-y - 0.2) = 0 
ox 

=2 (x + y- 3.0) + 2 (2x - y - 1.5) (-1) + 2 (x - y - 0.2) (-1) = 0 
dy 

(11.19) 

Equations (11.19) are called normal equations. Simplifying those gives reduced 
normal equations of 


6x — 2y — 6.2 = 0 

-2x + 3y- 1.3 = 0 (11.20) 

The simultaneous solution of Equations (11.20) yields x equal to 1.514 and 
y equal to 1.442. Substituting these adjusted values into the residual equations 
[Equations (11.17)] results in the numerical values for the three residuals. 
Table 11.1 provides a comparison of the arbitrary solution to the least squares 
solution. The tabulated summations of residuals squared shows that the least 
squares solution yields the smaller total and thus the better solution. In fact, 
it is the most probable solution for the unknowns based on the observations. 


TABLE 11.1 Comparison of an Arbitrary and Least Squares Solution 


Arbitrary Solution 

Least Squares Solution 

v, = 0.00 

v 2 = 0.00 

Vj = -0.044 

v 2 = 0.002 

v 2 = 0.00 

v 2 = 0.00 

v 2 = 0.085 

v 2 = 0.007 

v 3 = -0.02 

v 2 = 0.04 

v 3 = -0.128 

v 2 = 0.016 


£r 2 = 0.04 


£v 2 = 0.025 
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11.7 SYSTEMATIC FORMULATION OF THE NORMAL EQUATIONS 
11.7.1 Equal-Weight Case 

In large systems of observation equations, it would be helpful to use sys¬ 
tematic procedures to formulate the normal equations. In developing these 
procedures, consider the following generalized system of linear observation 
equations having variables of (A, B, C,..., TV). 


q x A b x B c x C + ■ ■ ■ + n j N — / x + v x 
Q2A 4* + C2C + ■ ■ ■ T u2A — 1 ~) V2 

: ( 11 . 21 ) 

g w A + b m B + c m C + • • • + n m A" l m + v m 

The squares of the residuals for Equations (11.21) are 

v 2 — (^g x A b x B -F c | £ + • • • + n x N — l x ) 

v 2 = ( a 2^ + + c 2^ + ■ ■ ■ + «2^ _ h) 

: ( 11 . 22 ) 
v rn = ( a nA + b„,B + c m C -\ -h n m N - l m ) 


Summing Equations (11.22), the function / (A, B, C,... ,N) = ^ v 2 is 
obtained. This expresses the equal-weight least squares condition as 

^ v 2 = ( a x A + b x B + CjC + • • • + n x N - /, ) 2 

2 

4 * ^2 A + (? 2 -^ + -f • • • + TI2N — I2 ) + ■ ■ ■ 

+ ( a m A + /7,„5 + c m C + • • • + n m N — (11.23) 

According to least squares theory, the minimum for Equation (11.23) is 
found by setting the partial derivatives of the function with respect to each 
unknown equal to zero. This results in the following normal equations: 

d V v 2 

--— — 2 (^ct x A -\-b x B~\-c x C H- • • ■ TUj N — /1 j ci x 

U/i 

+ 2 ^2^4 + ^ 2 -^ “1“ C 2 C + • • • + H 2 ^/V — ^2 H" ‘ ‘ * 

+ 2 ( & m A + b fll B + c m C + • • • + Ti m .N — ci m — 0 
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d Yv 2 

——-— = 2 (ci^A + + CjC + • • - b\ 

+ 2 (a 2 A + b 2 B+ c 2 C H-1- n 2 N - l 2 ) b 2 + • • • (11.24) 

+ 2 (a m /l + T> m 7? + c,„C + ■ ■ ■ + «,„/V - l m ) T7 m = 0 

a V v 2 

—— = 2 (ct^A + + CjC + • • • + yi\N — /j) vi\ 

+ 2 (a 2 4 + b 2 B + c 2 C + • • • + vi 2 N — l 2 ^ /? 2 * * * 

+ 2 (a m A + b m B + c m C + • • • + n m N - /,„) « m = 0 

Dividing each expression by 2 and regrouping the remaining terms in 
Equation (11.24) results in Equation (11.25): 

K + U \ + ' ' ' + «m) ^ + Ml + a 2 h 2 + ' ' ' + a m b m) B + Ml + a 2 C 2 + ' ' ' + Vm) C 

+ ''' + ( a i n i + a i n 2 + ''' + a m n m ) IV- (Vi + a 2 l 2 + ■ ■ ■ + a m l m ) = 0 
Mi + b i a i + • • • + b m a m ) A + (b\ + b\ + • • • + b 2 m ) B + (Vi + b 2 c 2 + • • • + b m c m ) C 

+ -1- {b x n x + b 2 n 2 H-F *,„«„,) N - (Vl + b 2 l 2 H-h &„,/,„) = 0 


! (11.25) 

("i a i + n 2 a 2 + • • • + n m a m ) A + Mi + n 2 b 2 + • • • + b m a m ) B + (n^ + n 2 c 2 + • • • + n m c m ) C 
+ ■ ■ ■ + [n\ +n\ + ■ ■ ■+n 2 m )N -(Vi +n 2 l 2 + ■ ■ ■+n m l m ) = 0 


Generalized equations expressing normal Equations (11.25) are now written as 
fl2 ) ^ + ( Z at) B + (X ac] C + • • • + ( X aw ) TV = X al 

(X ^ + (X bl ) B + (X be) C + ■ ■ ■ + (X bn) N = X bl 

( X, na] A + (X»A) B + (X»c) C + • • • + f X n 2 ^ TV = X «/ (11.26) 

In Equation (11.26) the a’s, /fs, c’s,s are the coefficients for the unknowns 

A,B,C,...,N; the / values are the observations; and 2 signifies the summation 
from / = 1 to 777 . 

11.7.2 Weighted Case 

In a manner similar to that of Section 11.7.1, it can be shown that normal 
equations can be systematically formed for weighted observation equations in 
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the following manner: 

waA + wab \ B + wac^j C + ■ ■ ■ + wan'j N = ^ wal 
^^ wba ^ A + ^ ^ wb 2 ^ B + ^ ^ w 7 6c^ C + • ■ ■ + f y ; wbn\ N = ^ ivZ>/ 

f y 1 , wna^ ^4 + t vnb'j B+ vv«cj C + • • • + f ^ tv« 2 ^ TV = ^ wnl 

(11.27) 

In Equation (11.27), vv are the weights of the observations, /; a’s, Zj’s, c’s, ..., n’s 
are the coefficients for the unknowns A, B, C,..., N, l values are the observa¬ 
tions; and ^ signifies the summation from i = 1 to m. 

Notice that the terms in Equations (11.27) are the same as those in 
Equations (11.26) except for the addition of the w’s, which are the relative 
weights of the observations. In fact. Equations (11.27) can be thought of as the 
general set of equations for forming the normal equations, since if the weights 
are equal, they can all be given a value of 1. In this case, they will cancel out 
of Equations (11.27) to produce the special case given by Equations (11.26). 

11.7.3 Advantages of the Systematic Approach 

Using the systematic methods just demonstrated, the normal equations can 
be formed for a set of linear equations without writing the residual equations, 
compiling their summation equation, or taking partial derivatives with respect 
to the unknowns. Rather, for any set of linear equations, the normal equations 
for the least squares solution can be written directly. 


11.8 TABULAR FORMATION OF THE NORMAL EQUATIONS 

Formulation of normal equations from observation equations can be simpli¬ 
fied further by handling Equations (11.26) and (11.27) in a table. In this way, 
a large quantity of numbers can be easily be manipulated. Tabular formula¬ 
tion of the normal equations for the example in Section 11.4.1 is illustrated 
below. First, Equations (11.17) are made compatible with the generalized form 
of Equations (11.21). These equations, the so-called observation equations, are 
shown in Equations (11.28). 


(7) x + y = 3.0 + i 7 ! 

(8) 2 x - y = 1.5 + v 2 

(9) x — y = 0.2 + v 3 


(11.28) 
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TABLE 11.2 Tabular Formation of Normal Equations 


Eqn. 

a 

b 

L 

a 2 

ab 

b 2 

al 

bl 

(7) 

t 

1 

3.0 

1 

1 

1 

3.0 

3.0 

(8) 

2 

-1 

1.5 

4 

-2 

1 

3.0 

-1.5 

(9) 

1 

-1 

0.2 

1 

E« 2 = 6 

-1 

YjUb = -2 

1 

2> 2 = 3 

02 

YjUl = 6.2 

-0.2 
Yfil= 1.3 


In Equations (11.28), there are two unknowns, x and y, with different coef¬ 
ficients for each equation. Placing the coefficients and the observations, /’s, 
for each expression of Equation (11.28) into a table, the normal equations are 
formed systematically. Table 11.2 shows the coefficients, appropriate products, 
and summations in accordance with Equations (11.26). 

After substituting the appropriate values for ^/r, J]ab, ]T/r, J^al, and ~Ypl 
from Table 11.2 into Equations (11.26), the following normal equations are 

6x — 2y = 6.2 

—2x + 3j = 1.3 (11.29) 

Notice that Equations (11.29) are exactly the same as those obtained 
in Section 11.6 using the theoretical least squares method. That is. 
Equations (11.29) match Equations (11.20). 


11.9 USING MATRICES TO FORM THE NORMAL EQUATIONS 

Note that the number of normal equations in a parametric least squares 
adjustment is always equal to the number of unknown variables. Often, the 
system of normal equations becomes quite large. But even when dealing with 
three unknowns, their solution by hand is time-consuming. As a consequence, 
computers and matrix methods as described in Appendixes A through C are 
almost always used today. In the following subsections, we present the matrix 
methods used in performing a least squares adjustment. 

11.9.1 Equal-Weight Case 

To develop the matrix expressions for performing least squares adjustments, 
an analogy will be made with the systematic procedures demonstrated in 
Section 11.7. For this development, let a system of observation equations be 
represented by the matrix notation 


AX=L+V 


(11.30) 
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where 


On 

a \2 ’ ' 

• • «1„ 

fl 21 

a 22 ’ ' 

• ’ a 2n 

a m\ 

®m2 

®mn 



V 


r/ii 


"V 

x = 

*2 

L = 

h 

v = 

^2 


_x n _ 


Jm_ 


y m_ 


Note that the above system of observation equations (11.30) is identical to 
Equations (11.21) except that the unknowns are x u x 2 ,..., x n instead of 
A, B,..., N, and the coefficients of the unknowns are a n , a n , ■ ■ ■, a hl instead 
of a l ,b l ,...,n v 

Subjecting the above matrices to the manipulations given in the following 
expression. Equation (11.31) produces the normal equations [i.e., matrix 
Equation (11.31a) is exactly equivalent to Equations (11.26)]: 

A T AX=A r L (11.31a) 


Equation (11.31a) can also be expressed as 

NX = A J L 


(11.31/7) 


where N represents the normal matrix. The correspondence between Equations 
(11.31) and Equations (11.26) becomes clear if the matrices are multiplied and 
analyzed as follows: 


A t A = 


a \\ a 2\ 
a \2 a 22 


l \n 


A 2n 


®m\ 

®m2 



«11 

fl 12 ’ 

■ a \n 


a 21 

a 22 ’ 

■ a 2n 


«ml 

®m2 

Cl 

mn 


»ll «12 
n 2l n 22 


«1 n 
«2 n 


= N 


a n\ a n2 ' ' ' a n 


a t l = 


a U a 2\ ■ 

a \2 a 22 ’ 

a \n «2n ’ 


“ml 

®ml 


][ ] a n l i 

i= 1 
m 

X a i2 l i 


7 = 1 


X a in l i 


i= 1 
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The individual elements of the normal matrix can be expressed in the fol¬ 
lowing summation forms: 


11 = Z a n 

i— 1 
m 

Z a i2 a i 


i— 1 


1 n 22 


‘12 - Z ° nU i2 

i= 1 
m 

2 


4 


i=l 


' 2 ;/ 


‘In = Z a il fl * 

i= 1 
m 

Z 


Z=1 


V - Z a m a i\ n n2 ~ Z a m a i2 
(=1 !=1 


= Z‘ 


(=1 


By comparing the summations above with those obtained in Equations 
(11.26), it should be clear that they are the same. Therefore, it is demonstrated 
that Equations (11.31a) and (11.316) produce the normal equations of a least 
squares adjustment. By inspection, it can also be seen that the normal matrix 
is always symmetric (i.e., = « ,). 

By employing matrix algebra, the solution of normal equations like 
Equation (11.31a) is 

X = (A T A)~ l A T L = N-'A t L (11.32) 


Example 11.1 To demonstrate this procedure, the problem of Section 11.6 will 
be solved. Equations (11.28) can be expressed in matrix form as 



1 

1 




3.0 


Vl 

AX = 

2 

1 

-1 

-1 


X 

y 

— 

1.5 

0.2 

+ 

^2 

v 3 


Applying Equation (11.31) to Equation (a) yields 


(a) 


A t AX = NX = 


2 

-1 


1 

-1 


1 1 

2 -1 

1 -1 


x 

y 



(b) 


and 




3.0 



1 2 1 




6.2' 

1 -1 -1 


1.5 

— 

1.3 



0.2 




A t L = 


(c) 
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Finally, the adjusted unknowns, X matrix, are obtained using the matrix 
methods of Equation (11.32). This yields 


x = n~ x a 7 l = 


6 

-2' 

-1 

6.2 


1.514 

-2 

3 


1.3 


1.442 


(d) 


Notice that the normal equations and the solution in this method are the 
same as those obtained in Section 11.6. 


11.9.2 Weighted Case 

A system of weighted linear observation equations can be expressed in matrix 
notation as 

WAX = WL + WV (11.33) 

Using the same methods as demonstrated in Section 11.9.1, it is possible to 
show that the normal equations for this weighted system are 

A 7 WAX=A 7 WL (11.34a) 

Equation (11.34a) can also be expressed as 

NX = A r WL (11.34 b) 

where N = (A 7 WA) is the so-called normal matrix. 

By employing matrix algebra, the least squares solution of these weighted 
normal equations is 


X = (A t WA) 1 A t WL = N~ x A t WL (11.35) 

In Equation (11.35), Wis the weight matrix as defined in Chapter 10. 


11.10 LEAST SQUARES SOLUTION OF NONLINEAR SYSTEMS 

I n Appendix C, a method is presented to solve a nonlinear system of 
equations using a first-order Taylor series approximation of the nonlinear 
equation. Following this procedure, the least squares solution for a systems of 
nonlinear equations can be found as follows: 

Step 1: Write the first-order Taylor series approximation for each equation. 

Step 2: Determine initial approximations for the unknowns in the equations 
of Step 1. 









208 PRINCIPLES OF LEAST SQUARES 


Step 3: Use matrix methods similar to those discussed in Section 11.9, to find 
the least squares solution for the equations of Step 1 (these are corrections 
to the initial approximations). 

Step 4: Apply the corrections to the initial approximations. 

Step 5: Repeat Steps 3 through 4 until the corrections become sufficiently 
small. 

A system of nonlinear equations that are linearized by a Taylor series 
approximation can be written as 

JX = K+V (11.36) 

where the Jacobian matrix J contains the coefficients of the linearized observa¬ 
tion equations. The individual matrices in Equation (11.36) are 


d l± 


d l± 

dx l 

dx 2 

dx n 

dF 2 

dF 2 

dF 2 

dx { 

dx 2 

dx„ 

dF m 

dF m 

dF m 

d.Xj 

dx 2 

dx„ 



dx l 


\h 

~ F \ (h^'2L 

■x n )~ 


'vr 


dx 2 


h 

— F 2 (X!,X 2 ,- 

■x„) 


^2 

X = 


K = 


v = 



dx n 


Jm 

— F m (X\,X 2 ,- 



; v n_ 


The vector of least squares corrections in the equally weighted system of 
Equation (11.36) is given by 


X=(J T J)~ 1 J T K = N~ 1 J T K 

(11.37) 

Similarly, the system of weighted equations is 


WJX = WK 

(11.38) 

and its solution is 


X= (J r Wjy l J T WK = N~ l J T WK 

(11.39) 


where W is the weight matrix as defined in Chapter 10. Notice that the least 
squares solution of a nonlinear system of equations is similar to the linear case. 
In fact, the only difference is the use of the Jacobian matrix J rather than the 
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coefficient matrix A and the use of the K matrix rather than the observation 
matrix, L. Many authors use the same nomenclature for both the linear and 
nonlinear cases. In these cases, the differences in the two systems of equations 
are stated implicitly. 

Example 11.2 Find the least squares solution for the following system of 
nonlinear equations: 

F : x + y - 2y 2 = -4 

G: x 2 + y 2 =8 (e) 

H : 3x 2 - y 2 = 7.7 


SOLUTION 

Step 1: Determine the elements of the / matrix by taking partial derivatives 
of Equation (e) with respect to the unknowns x and y. Then write the 
first-order Taylor series equations. 


dF 

dx 

dF 

dy 


1-4 y 


— =2x — 

dx dx 

dG_ =1 , d JL 

dy ^ dy 


6x 


- 2 y 



1 

1 “4 y 0 


dx 

JX = 

2x 0 

2j 0 


dv 


6a- 0 

-2j 0 


ay 


~4 ~F(x 0 ,y 0 ) 
8-G(x 0 ,y 0 ) 
7.7-H(x 0 ,y 0 ) 


= K 


(/) 


Step 2: Determine initial approximations for the solution of the equations. 
Initial approximations can be derived by solving any two equations for 
x and y. This was done in Section C.3 for the equations for (F) and (G), 
and their solution was x 0 = 2 and y 0 = 2. Using these values, the evalua¬ 
tion of the equations yields 


F (*o>To) = -4 G (x 0 ,y 0 ) = 8 H (x 0 ,y 0 ) = 8 (g) 


Substituting Equations (g) into the K matrix of Equation (/), the K matrix 
becomes 


-4 - (-4) 


0 

8-8 

= 

0 

7.7-8 


-0.3 


It should not be surprising that the first two rows of the K matrix are zero since 
the initial approximations were determined using these two equations. In suc¬ 
cessive iterations, these values will change and all terms will become nonzero. 
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Step 3: Solve the system using Equation (11.37). 


N = J l J = 


J l K = 


1 4 12 

-7 4 -4 

1 4 12 

-7 4 -1 



1 

A 

-7" 

A 


161 

-39' 


12 

-4 


-39 

81 



o’ 






-3.6' 


0 

— 

1.2 


-0.3 




(A) 


Substituting the matrices of Equation ( h) into Equation (11.37), the solution 
for the first iteration is 1 


X = N~ l J T K = 


-0.02125 

0.00458 


Step 4: Apply the corrections to the initial approximations for the first iter¬ 
ation. 


x 0 = 2.00 - 0.02125 = 1.97875 y 0 = 2.00 + 0.00458 = 2.00458 
Step 5: Repeating steps 2 through 4, results in 


157.61806 

-38.75082' 

-1 

-0.017225' 

-38.75082 

81.40354 


-0.003307 


- 0.00011 
- - 0.00001 

x = 1.97875 - 0.00011 = 1.97864 
y = 2.00458 - 0.00001 = 2.00457 

Iterating a third time yields extremely small corrections, and thus, the final 
solution, rounded to the hundredths place, is x = 1.98 and y = 2.00. Notice that 
N changed by a relatively small amount from the first iteration to the second 
iteration. If the initial approximations are close to their final values, this can 
be expected. Thus, when doing these computations by hand, it is common to 
use the initial N for each iteration, making it necessary only to recompute J T K 
between iterations. However, this procedure should be used with caution, since, 
if the initial approximations are poor, it will result in an incorrect solution. 

1 Note that although the solution represents more significant figures than can be warranted by the 
observations, it is important to carry more digits than are desired for the final solution. Failure to 
carry enough digits can result in a system that will never converge; rather it may bounce above and 
below the solution, or it may take more iterations due to these rounding errors. Many beginning 
students make this mistake. The answer should be rounded only after solving the problem. 
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One should always perform complete computations when doing the solution 
with the aid of a computer. 


11.11 LEAST SQUARES FIT OF POINTS TO A LINE OR CURVE 

Frequently in engineering work, it is desirable or necessary to ht a 
straight line or curve to a set of points with known coordinates. In solving this 
type of problem, it is first necessary to decide on the appropriate functional 
model for the data. The decision whether to use a straight line, parabola, or 
some other higher-order curve can generally be made after plotting the data 
and studying their form or by checking the size of the residuals after the least 
squares solution with the first selected line or curve. 


11.11.1 Fitting Data to a Straight Line 

Consider the data illustrated in Figure 11.2. The straight line shown in the 
figure can be represented by this equation: 

y = mx + b (11.40) 

In Equation (11.40), x and y are the coordinates of a point, m is the slope 
of a line, and b is the y intercept at x = 0. If the points were truly linear, 
and there were no observational or experimental errors, all coordinates would 
lie on a straight line. However, this is rarely the case, as seen in Figure 11.2, 
and thus, it is possible that (1) the points contain errors, (2) the functional 
model is a higher-order curve, or both. If a line is selected as the model for 
the data, the equation of the best-fitting straight line is found by adding resid¬ 
uals to Equations (11.40). This accounts for the errors shown in the figure. 



FIGURE 11.2 Fitting points on a line. 
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Observation equations for the four data points A,B.C, and D of Figure 11.2 are 
rewritten as 


mx A + b = y A + Vy A 
mx B + b = y B + v yB 

mx c + b = y c + v yc (11.41) 

mx D + b = y n + v yn 

Equations (11.41) contain two unknowns, m and b, with four observations. 
Their matrix representation is 

AX = L+V (11.42) 

where 


x A 1 
x B 1 
x c 1 
x D 1 

X = 

m 

L = 

y A 

y B 

v = 

i- 


b 


yc 

Jd_ 


V Tc 

LuJ 


Equation (11.42) is solved by the least squares method using Equation 
(11.32). If some data were more reliable than others, relative weights could 
be introduced and a weighted least squares solution could be obtained using 
Equation (11.35). 

Example 11.3 Find the best-fit straight line for the following points whose 
x and y coordinates are given in parentheses. 

A : (3.00, 4.50) B : (4.25, 4.25) C : (5.50, 5.50) D : (8.00, 5.50) 

SOLUTION Following Equations (11.41), the four observation equations for 
the coordinate pairs are 


3.00 m + b = 4.50 + v A 
4.25 in + b= 4.25 + v B 
5.50 in + b= 5.50 + v c 
8.00/n + b = 5.50 + v D 


Rewriting Equations (?) into matrix form yields 


3.00 1 
4.25 1 
5.50 1 
8.00 1 


/?? 

b 


4.50 
4.25 

5.50 
5.50 


V B 

Vc 

V D 


(0 


(/■) 
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To form the normal equations, premultiply matrices A and L of Equation (/') 
by A r and get 


121.3125 

20.7500' 

m 


105.8125 ' 

20.7500 

4.0000 

b 


19.7500 


The solution of Equation (k) is 


m 


121.3125 

20.7500' 

-1 

105.8125' 


0.246' 

b 


20.7500 

4.0000 


19.7500 


3.663 


Thus, the most probable values for m and b to the nearest hundredth are 0.25 
and 3.66, respectively. To obtain the residuals, Equation (11.30) is rearranged 
into residual equations and solved as 


'3.00 

1 



'4.50' 


- 0 . 10 ' 

4.25 

1 


0.246' 


4.25 


0.46 

5.50 

1 


3.663 


5.50 


-0.48 

8.00 

1 



5.50 


0.13 


11.11.2 Fitting Data to a Parabola 

For certain data sets or in special situations, a parabola will fit the situation 
best. An example would be fitting a vertical curve to an existing roadbed. The 
general equation of a parabola is 

Ax 2 + Bx + C = y (11.43) 

Again, since the data rarely fit the equation exactly, residuals are introduced. 
For the data shown in Figure 11.3, the following observation equations can be 
written: 

Ax 2 a + Bx a + C = y a + v a 
Ax 2 + BXfy + C — 37 , + v h 

Ax 2 + Bx c + C = y c + v c (11.44) 

Ax 2 d + Bx d + C = y d + v d 
Ax 2 + Bx e + C = y e + v e 

Equations (11.44) contain three unknowns, A , B , and C, with five equations. 
Thus, this represents a redundant system that can be solved using least squares. 
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Y 



FIGURE 11.3 Fitting points on a parabolic curve. 

In terms of the unknown coefficients, Equations (11.44) are linear and can be 
represented in matrix form as 


AX=L+V (11.45) 

Since this is a linear system, it is solved using Equation (11.32). If weights 
were introduced, Equation (11.35) would be used. The steps taken would be 
similar to those used in Section 11.11.1. 


11.12 CALIBRATION OF AN EDM INSTRUMENT 

Calibration of an EDM is necessary to ensure confidence in the distances it 
measures. In calibrating these devices, if they internally make corrections and 
reductions for atmospheric conditions, Earth curvature, and slope, it is first nec¬ 
essary to determine if these corrections are made properly. Once these correc¬ 
tions are applied properly, the instruments with their reflectors must be checked 
to determine their constant and scaling corrections. This is often accomplished 
using a calibration baseline. The observation equation for an electronically 
observed distance on a calibration baseline is 

SD a + C = D h -D a + V dh (11.46) 

In Equation (11.46), S is a scaling factor for the EDM; C is an 
instrument-reflector constant; D H is the observed horizontal distance 
with all atmospheric and slope corrections applied; D A is the published 
horizontal calibrated distance for the baseline; and V DH is the residual error 
for each observation. This is a linear equation with two unknowns, S and C. 
Systems of these equations can be solved using Equation (11.31). 

Example 11.4 A surveyor wishes to use an instrument-reflector combination 
that has an unknown constant value. Calibration baseline observations were 
carefully made, and following the manufacturer’s recommendations, the neces¬ 
sary corrections were applied for the atmospheric conditions. Earth curvature. 
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TABLE 11.3 EDM Instrument-Reflector Calibration Data 


Distance 

D a (meters) 

D h (meters) 

Distance 

D a (meters) 

D h (meters) 

0-150 

149.9975 

150.0175 

150-0 

149.9975 

150.0174 

0-430 

430.0101 

430.0302 

430-0 

430.0101 

430.0304 

0 - 1400 

1400.0030 

1400.0223 

1400 - 0 

1400.0030 

1400.0221 

150-430 

280.0126 

280.0327 

430- 150 

280.0126 

280.0331 

150- 1400 

1250.0055 

1250.0248 

1400- 150 

1250.0055 

1250.0257 

430- 1400 

969.9929 

970.0119 

430 - 1400 

969.9929 

970.0125 


and slope. Use these corrected distances and their published values listed in 
Table 11.3 to determine the instrument-reflector constant (C) and scaling fac¬ 
tor ( S ) for the system. 


SOLUTION Following Equation (11.46), the matrix equation for this 
problem is 


' 149.9975 1 
149.9975 1 
430.0101 1 

430.0101 1 

1400.0030 1 
1400.0030 1 
280.0126 1 
280.0126 1 
1250.0055 1 
1250.0055 1 
969.9929 1 
969.9929 1 


S 

C 


150.0175 - 
150.0174 - 
430.0302 ■ 
430.0304 ■ 
1400.0223 ■ 
1400.0221 ■ 
280.0327 ■ 
280.0331 ■ 
1250.0248 ■ 
1250.0257 ■ 
970.0119 
970.0125- 


149.9975 

149.9975 

430.0101 

430.0101 

1400.0030 

1400.0030 

280.0126 

280.0126 

1250.0055 

1250.0055 

969.9929 

969.9929 


+ V 


Using Equation (11.32), the solution is S = -0.0000007 (-0.7 ppm) and 
C = 0.0203. Thus, the constant value for the instrument-reflector pair is 
approximately 0.020 m, or 20 mm. 


11.13 LEAST SQUARES ADJUSTMENT USING CONDITIONAL 
EQUATIONS 

As stated in Section 11.5, observations can also be adjusted using conditional 
equations. In this section, this form of adjustment is demonstrated by using 
the condition that the sum of the angles in the horizon at a single station must 
equal 360°. 
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Example 11.5 While observing angles at a station, the horizon was closed. 
The following observations and their standard deviations were obtained. 


No. 

Angle 

5(") 

«i 

134°38'56" 

±6.7 

a 2 

83°17'35" 

±9.9 

a 3 

142°03T4" 

±4.3 


What are the most probable values for the observations above? 

SOLUTION In a conditional adjustment, the most probable set of residuals 
are found that satisfy a given functional condition. In this case, the condition is 
that the sum of the three angles is equal to 360°. Since the three observed angles 
actually sum to 359°59'45", the angular misclosure is 15". Thus, errors are 
present. The following residual equation is written for the observations listed 
above. 

Vi + v 2 + v 3 = 360° - (oj + a 2 + a 3 ) = 15" (/) 

In Equation (/), the a x , a 2 , and a 3 represent the observations and v x ,v 2 , and v 3 
are their residuals. 

Applying the fundamental condition for a weighted least squares adjust¬ 
ment, the following equation must be minimized: 

F = h’j v\ + w 2 v\ + w 3 v 3 (rn) 

where the uq, w 2 , and vv 3 are weights, which are the inverses the observations’ 
variances. 

Equation (/) can be rearranged such that v 3 is expressed as a function of the 
other two residuals: 

v 3 = 15" - (vj + v 2 ) (n) 

Substituting Equation («) into Equation (m) yields 

F = W jVj + W 2 v\ + vv 3 [l 5" - (v 3 + v 2 )] 2 (o) 

Taking the partial derivatives of F with respect to both v, and v 2 , respectively, 
in Equation (o) results in two the following two equations: 

— = 2w 1 v 1 + 2w 3 [15" - (vj + vt)1 (-1) = 0 
dv x L 1 

= 2vr 2 v 2 + 2w 3 [15" - (vj + v 2 )] (-1) = 0 


ip) 
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Rearranging Equations (p ) and substituting in the 
the following normal equations. 

( —r 4-Vj 4- — v 2 =15 

V 6.7 2 4.3 V 4.3 2 

—-Vj 4- ( —- 4-y ) v 2 = 15 

4.3 2 V 9.9 2 4.3 2 / 

Solving Equations ( q ) for v ( and v 2 yields 

Vj = 4.2" 
v 2 = 9.1" 

By substituting these residual values into Equation («), residual o 3 is com¬ 
puted as 

v 3 = 15" - (4.2" + 9.1") = 1.7" 

Finally, the adjusted observations are obtained by adding the computed resid¬ 
uals to the observations. 


appropriate weights yields 


4.3 J 


4.3 J 


(?) 


No. 

Observed Angle 

v(") 

Adjusted Angle 

«i 

134°38 / 56" 

4.2 

134°39 / 00.2" 

a 2 

83°17'35" 

9.1 

83°17 / 44.1" 

a 3 

142°03'14" 

1.7 

142°03 / 15.7" 




^ = 360°00 / 00.0" 


Note that geometric closure has been enforced in the adjusted angles to make 
their sum exactly 360°. Also notice that the angle having the smallest standard 
deviation received the smallest correction (i.e., its residual is smallest). 


11.14 THE PREVIOUS EXAMPLE USING OBSERVATION EQUATIONS 

Example 11.5 can also be done using observation equations. In this case, the 
three observations are related to their adjusted values and their residuals by 
writing observation equations: 


a x = 134°38'56" + vj 

a 2 = 83°17 , 35" 4- v 2 (r) 

a 3 = 142°03'14" 4- v 3 
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While these equations relate the adjusted observations to their observed values, 
they cannot be solved in this form. What is needed is the geometric constraint 2 
that states that the sum of the three angles equals 360°. This can be represented 
in equation form as 

a \ + a 2 + fl 3 = 360 ° ( s ) 


Rearranging Equation (s) to solve for a 3 yields 

a 3 = 360° - (oj + a 2 ) ( t ) 

Substituting Equation ( t ) into Equations (r) produces 


a x = 134°38'56" + v ( 

a 2 = 83°17'35" +v 2 

360° - ( fll + a 2 ) = 142°03'14" + v 3 


This is a linear problem, with two unknowns, a x and a 2 . The weighted obser¬ 
vation equation solution is obtained by solving Equation (11.35). The appro¬ 
priate matrices for this problem are 





1 

0 

0 



1 

0 

0 

1 

w = 

6.7 2 

0 

1 

0 

L = 

134°38'56" 

83°17'35" 

-1 

-1 


0 

9.9 2 

0 

1 


142°03 / 14" - 360° 






4.3 2 . 




Performing the matrix manipulations, the matrices for the normal equations 
are 


A t WA = 


0 

1 


-1 

-1 


6 . 7 2 

0 

0 


0 

1 

9 . 9 2 

0 


A J WL = 


14.7867721 

12.6370848 


0 

0 

l 

4 . 3 2 


1 0 

0 1 

-1 -1 


0.07636 

0.050408 


0.05408 

0.06429 


Finally, X is computed as 


X=(A t WA ) 1 a t wl 


134°39'00.2" 

83°17'44.1" 


2 Chapter 20 covers the use of constraint equations in a least squares adjustment. However, the 
fixing of control is also an example of a constraint. Constraints are typically required for an adjust¬ 
ment. In Chapter 20, the adjustment of control is discussed. 
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Using Equation (?), it can now be determined that a 3 is 360° - 134°39'00.2" 
- 83°17'44.1" = 142°03 , 15.7". The same results are obtained as in Section 
11.13. It is important to note that no matter what method of least squares 
adjustment is used, if the procedures are performed properly, the same solu¬ 
tion will always be obtained. This example involved constraint equation (?). This 
topic is covered in more detail in Chapter 20. 


11.15 SOFTWARE 

As was initially stated, the method of least squares was not used commonly 
due to its computational intensiveness. Today, software has eliminated this hin¬ 
drance. On the companion website the spreadsheet in the hie Chapter ll.xls 
demonstrates the least squares solution to the example problems in this chapter. 
It uses several of the techniques discussed in Section 8.6 to manipulate the 
matrices. Additionally, on the companion website is the Mathcad® worksheet 
Cll.xmcd, which demonstrates the programming of all of the examples in this 
chapter. These examples should be studied by the reader. Similar programming 
can be used to solve the problems at the end of this chapter. For those who 
wish to create a more robust program, a higher-level programming language 
can be used. 

Both spreadsheet and Mathcad software are available for the reader in 
many of the remaining chapters. The spreadsheet software files are named as 
Chapter##, xls where ## represents the chapter number. The Mathcad work¬ 
sheets are similarly named after their representative chapter. These hies demon¬ 
strate some of the programming techniques that are used to solve the example 
problems in this book. Readers are encouraged to investigate these hies while 
studying the subject material in this book. 


PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

*11.1 Calculate the most probable values for A and B in the equations below 
by the method of least squares. Consider the observations to be of 
equal weight. (Use the tabular method to form normal equations.) 

(a) 3A + 2B = 7.8 + v, 

(b) 2A-3B = 2.5 + v 2 

(c) 6A-7B = 8.5 + Vj 

11.2 If observations a, b, and c in Problem 11.1 have weights of 2, 4, 
and 5, respectively, solve the equations for the most probable values 
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of A and B using weighted least squares. (Use the tabular method to 
form normal equations.) 

11.3 Repeat Problem 11.1 using matrices. 

11.4 Repeat Problem 11.2 using matrices. 

11.5 Calculate the most probable values of X and Y for the following sys¬ 
tem of equations using 

(a) Tabular method. 

(b) Matrix method. 

3X + 4F = 24.1 + vj 
5X - 2F=13.8 + v 2 
X -3Y = 13.2 + v 3 

*11.6 What are the residuals for the system of equations in Problem 11.5? 

*11.7 Solve the following nonlinear equations using the least squares 
method. Use initial approximations of x 0 = 2.1 and y 0 = 0.45. 

x 2 + 3 xy - y 2 = 7.0 + v 3 
7x 3 - 3 y 2 = 55.2 + v 2 
2x - 6 xy + 3 y 2 = -1.2 + v 3 

11.8 What are the residuals for the system of equations in Problem 11.7? 

11.9 Repeat Problem 11.7 for the following system of nonlinear equations 
using initial approximations of x 0 = 2.8 and y 0 = 5.6. 

1:2x 2 - 5xy + y 2 = -31.3 + vj 
2: 3x 2 - 2y 2 = -39.0 + v 2 

3: 6 xy - 3y 2 = 0.2 + v 3 

11.10 If observations 1, 2, and 3 in Problem 11.9 have weights of 3, 2, and 
1 , respectively, solve the equations for: 

(a) the most probable values of v and y. 

(b) the residuals. 

11.11 The following coordinates of points on a line were computed for a 
block. What are the slope and ^’-intercept of the line? What is the 
azimuth of the line? 
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* 11.12 


11.13 

11.14 


Point 

x (ft) 

Y (ft) 

1 

1254.72 

3373.22 

2 

1362.50 

3559.95 

3 

1578.94 

3934.80 

4 

1843.68 

4393.35 

Using the conditional equations, what 

are the most probable values 

for the three angles observed to close the horizon at station Red. The 
observed values and their standard deviations are 

Angle 

Value 

sn 

1 

114°23'05" 

+6.5 

2 

138° 17'59" 

±3.5 

3 

107°19'03" 

±4.9 

Do Problem 11.12 using the observation equation method. 

Using the conditional equation method, what are the most probable 
values for the three interior of a triangle that were measured as: 

Angle 

15 

sn 

1 

65°23'56" 

±7.6 

2 

83° 15'43" 

±4.3 

3 

3U21T2" 

±8.4 


11.15 Do Problem 11.14 using the observation equation method. 

11.16 Eight blocks of the Main Street are to be reconstructed. The exist¬ 
ing street consists of jogging, short segments as tabulated in the tra¬ 
verse survey data below. Assuming coordinates of X = 1000.0 and 
Y = 1000.0 at station A, and that the azimuth of AB is 90°, define a 
new straight alignment for a reconstructed street passing through this 
area that best conforms to the present alignment. Give the Tintercept 
and the azimuth of the new alignment. 
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Course 

Length (ft) 

Station 

Angle to Right 

AB 

635.74 

B 

180°01'26" 

BC 

364.82 

C 

179°59'52" 

CD 

302.15 

D 

179°48'34" 

DE 

220.08 

E 

180°01'28" 

EF 

617.36 

F 

179°59'05" 

EG 

429.04 

G 

180°01'37" 

GH 

HI 

387.33 

234.28 

H 

179°59'56" 


11.17 Use the ADJUST software to do Problem 11.16. 

11.18 The property corners on a single block with an alley are shown as a 
straight line with a Due East bearing on a recorded plat. During a 
recent survey, all the lot corners were found, and measurements from 
the Station A to each were obtained. The surveyor wants to determine 
the possibility of disturbance of the corners by checking their fit to a 
straight line. A sketch of the situation is shown in Figure 11.4, and the 
results of the survey are given below. Assuming Station A has coor¬ 
dinates of X = 5000.00 and Y = 5000.00, and that the coordinates of 
the backsight station are X = 5000.10 and Y = 5200.00, determine the 
best fitting line for the corners. Give the Y intercept and the azimuth 
of the best-fit line. 


Course 

Distance (ft) 

Angle at A 

AB 

100.02 

90°00'16" 

AC 

200.12 

90°00'08" 

AD 

300.08 

89°59'48" 

AE 

399.96 

90°01 / 02" 

AF 

419.94 

89°59'48" 

AG 

519.99 

90°00 / 20" 

AH 

620.04 

89°59'36" 

AI 

720.08 

90°00'06" 


To 

backsight 

A 



A 


-O-O-O-0-0 

S C D E F 

FIGURE P11.18 


o 

G 


-o-o 

H I 
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11.19 Use the ADJUST software to do Problem 11.18. 

11.20 Using a procedure similar to that in Section 11.7.1, derive 
Equations (11.27). 

11.21 Using a procedure similar to that used in Section 11.9.1, show that the 
matrix operations in Equation (11.34) result in the normal equations 
for a linear set of weighted observation equations. 

11.22 Discuss the importance of selecting the stochastic model when adjust¬ 
ing data. 

11.23 The values for three angles in a triangle, observed using a total station, 
are 


Angle 

Number of Repetitions 

Value 

A 

2 

14°25'20" 

B 

4 

58°16'00" 

C 

4 

107°19T0" 


The observed lengths of the course are 

AB = 971.25 ft; BC = 253.25 ft; CA = 865.28 ft 
The following estimated errors are assumed for each measurement: 

c7j +0.005 ft; (jf — +0.005 ft; <7 jsq — +2 

What are the most probable values for the angles? Use the condition 
equation method. 

11.24 Do Problem 11.23 using observation equations and a constraint as 
presented in Section 11.13. 

11.25 The following data were collected on a calibration baseline. Atmo¬ 
spheric refraction and Earth curvature corrections were made to 
the measured distances, which are in units of meters. Determine the 
instrument/reflector constant and any scaling factor. 


Distance 

d a 

d h 

Distance 

d a 

d h 

0-150 

149.9104 

149.9447 

150-0 

149.9104 

149.9435 

0-430 

430.0010 

430.0334 

430-0 

430.0010 

430.0340 

0-1400 

1399.9313 

1399.9777 

1400 - 0 

1399.9313 

1399.9519 

150-430 

280.0906 

208.1238 

430- 150 

280.0906 

280.1230 

150- 1400 

1250.0209 

1250.0795 

1400- 150 

1250.0209 

1250.0664 

430- 1400 

969.9303 

969.9546 

1400 - 430 

969.9303 

969.9630 
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11.26 A survey of the centerline of a horizontal curve is done to determine 
the as-built curve specifications. The coordinates for the points along 
the curve are: 


Point 

U(ft) 

Y (ft) 

1 

9,821.68 

9,775.84 

2 

9,876.40 

9,842.74 

3 

9,975.42 

9,955.42 

4 

10,079.50 

10,063.40 

5 

10,151.60 

10,132.68 


(a) Using Equation (C. 10), compute the most probable values for the 
radius and center of the circle. 

(b) If two points located on the tangents have coordinates of (9761.90, 
9700.66) and (10,277.88, 10,245.84), what are the coordinates of 
the PC and PT of the curve? 





CHAPTER 12 


ADJUSTMENT OF LEVEL NETS 


12.1 INTRODUCTION 

Differential leveling observations are used to determine differences in ele¬ 
vations between stations. As with all observations, these measurements are 
subject to random errors that can be adjusted using the method of least 
squares. In this chapter, the observation equation method for adjusting 
differential leveling observations by least squares is developed, and several 
examples are given to illustrate the adjustment procedures. 


12.2 OBSERVATION EQUATION 

To apply the method of least squares in leveling adjustments, a prototype 
observation equation is first written for any elevation difference. Figure 12.1 
illustrates the functional relationship for an observed elevation difference 
between two stations I and J. The equation is expressed as 

Ej - E, = AEleVij + v A£/eVj . (12.1) 

This prototype observation equation relates the unknown elevations of any 
two stations, / and /, with the differential leveling observation A Elevy and 
its residual Av Elev ... This equation is fundamental in performing least squares 
adjustments of differential level nets. 
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12.3 UNWEIGHTED EXAMPLE 


In Figure 12.2, a leveling network and its survey data are shown. Assume that 
all observations are equal in weight. In this figure, arrows indicate the direction 
of leveling and thus, for line 1, leveling proceeds from bench mark X to A with 
an observed elevation difference of +5.10 ft. By substituting into prototype 
Equation (12.1), an observation equation is written for each observation in 
Figure 12.2. The resulting equations are 


A 

-A 


-A 


-BMT = 5.10 + Vj 
+BM Y = 2.34 + v 2 
C -BM Y = -1.25 + v 3 
-C +BMJ = -6.13 + v 4 
B = -0.68 + v 5 

B -BM Y = -3.00 + v 6 

-B C = 1.70 + v 7 


( 12 . 2 ) 


Rearranging so that the known bench marks are on the right-hand side of 
the equations and substituting in their appropriate elevations yields 


A = +105.10 + Vj 

—A —+105.16 + V 2 



C = +106.25 +v 3 


-C = -106.13 + v 4 

+B 

= - 0.68 + v 5 

B 

= +104.50 +v 6 

-B 

+C = 1.70 + v 7 


(12.3) 
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BM X= 100.00 



Observed 
Elevation 
Line Difference 

~i 5/10 

2 2.34 

3 -1.25 

4 -6.13 

5 -0.68 

6 -3.00 

7 1.70 


FIGURE 12.2 Interlocking leveling network. 


In this example, there are three unknowns, A, B , and C. In matrix form, 
Equations (12.2) are written as 


AX+B=L+V 


(12.4a) 


where 


1 

0 

o' 


'-100.00' 

-1 

0 

0 


+ 107.50 

0 

0 

1 


A 


-107.50 

0 

0 

-1 

X = 

B 

5 = 

100.00 

-1 

1 

0 


C 


0 

0 

1 

0 




-107.50 

0 

-1 

1 


0 


5.10' 


Vl 

2.34 


v 2 

-1.25 


v 3 

-6.13 

V = 

^4 

-0.68 


^5 

-3.00 


*6 

1.70 


v 7 


In Equation (12.4a), the B matrix is a vector of the constants (bench marks) 
collected from the left-side of the equation and L a collection of leveling 
observations. The right side of the Equation (12.3) is equal to L - B. It is a 
collection of the constants in the observation equations and is often referred 
to as the constants matrix, L. Since the bench marks can be also thought of 
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as observations, this combination of bench marks and leveling observation is 
referred to as L in this book and Equation (12.4a) is simplified as 

AX=L+V (12.46) 

Also note in the A matrix that when an unknown does not appear in an 
equation, its coefficient is zero. Since this is an unweighted example, according 
to Equation (11.31) the normal equations are 


(A t A) =nx = 


3 

-1 

0 

~A 


"210.94“ 

-1 

3 

-1 

B 

and A t L = 

102.12 

0 

-1 

3 

C 


214.08 


Using Equation (11.32), the solution of Equation (12.5) is 


(12.5) 



3 

-1 0 

-1 

"210.94" 

X = N~ 1 A t L = 

-1 

3 -1 


102.12 


0 

-1 3 


214.08 


0.38095 

0.14286 

0.04762 


0.14286 

0.42857 

0.14286 


0.04762 

0.14286 

0.38095 


210.94 

102.12 

214.08 


105.14 

104.48 

106.19 


( 12 . 6 ) 


From Equation (12.6), the most probable elevations for A, 5, and 
C are 105.14, 104.48, and 106.19, respectively. The rearranged form of 
Equation (12.46) is used to compute the residuals as 


V = AX - L (12.7) 

From Equation (12.7), the matrix solution for V is 


1 

0 

o' 


105.10" 


0.041" 

-1 

0 

0 


-105.16 


0.019 

0 

0 

1 

105.141 


106.25 


-0.062 

0 

0 

-1 

104.483 

— 

-106.13 

= 

-0.058 

-1 

1 

0 

106.188 


-0.68 


0.022 

0 

1 

0 



104.50 


-0.017 

0 

-1 

1 


1.70 


0.005 
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12.4 WEIGHTED EXAMPLE 

I n Section 10.6, it was shown that relative weights for adjusting level lines 
are inversely proportional to the lengths of the lines: 


1 

length 


( 12 . 8 ) 


The application of weights to the least squares adjustment of the level circuit 
is illustrated by including the variable line lengths for the unweighted example 
of Section 12.3. These line lengths for the leveling network of Figure 12.2 and 
their corresponding relative weights are given in Table 12.1. For convenience, 
each length is divided into the constant 12, so that integer “relative weights” 
were obtained. (Note that this is an unnecessary step in the adjustment.) The 
observation equations are now formed as in Section 12.3, except that in the 
weighted case, each equation is multiplied by its weight. 


VTj ( A 


) = vrd+105.10) + wqvj 

vv 2 (—A 


) = w 2 (—105.16) + w 2 v 2 

w 3 ( 


C') — vr 3 (+106.25) + w 3 v 3 

>v 4 ( 


-C) = w’ 4 (-106.13) + vv 4 v 4 

vv 5 (—A +B 

) = n’ 5 (- 0 . 68 ) + W 5 V 5 

w 6 ( 

B 

) = vr 6 (+104.50) + w 6 v 6 

w 7 ( 

-B 

+ C) = vr 7 (+1.70) + iv 7 v 7 


After dropping the residual terms in Equation (12.9), they can be written in 
terms of matrices as 


'3 

0 

0 

0 

0 

0 

o' 



1 

0 o' 

0 

4 

0 

0 

0 

0 

0 



1 

0 0 

0 

0 

6 

0 

0 

0 

0 



0 

0 

1 

0 

0 

0 

4 

0 

0 

0 



0 

0 - 

1 

0 

0 

0 

0 

6 

0 

0 



1 

1 0 

0 

0 

0 

0 

0 

6 

0 



0 

1 0 

0 

0 

0 

0 

0 

0 

6 



0 

-1 0 


'3 

0 

0 

0 

0 

0 

0 



105.10 



0 

4 

0 

0 

0 

0 

0 



105.16 



0 

0 

6 

0 

0 

0 

0 



106.25 


= 

0 

0 

0 

4 

0 

0 

0 



106.13 



0 

0 

0 

0 

6 

0 

0 



-0.68 



0 

0 

0 

0 

0 

6 

0 



104.50 



0 

0 

0 

0 

0 

0 

6 



1.70 
















230 ADJUSTMENT OF LEVEL NETS 


TABLE 12.1 Weights for Example in Section 12.2 


Line 

Length (mi) 

Relative Weights 

1 

4 

12/4 = 3 

2 

3 

12/3 = 4 

3 

2 

12/2 = 6 

4 

3 

12/3 = 4 

5 

2 

12/2 = 6 

6 

2 

12/2 = 6 

7 

2 

12/2 = 6 


Applying Equation (11.34), we find the normal equations are 


(A t WA)X = NX = A t WL 


( 12 . 11 ) 


where 


N = 


1 

0 

0 


-1 

0 

0 


0 0-10 0 
0 0 11-1 
1-1 0 0 1 


3 0 0 0 
0 4 0 0 
0 0 6 0 
0 0 0 4 
0 0 0 0 
0 0 0 0 
0 0 0 0 


0 0 0 
0 0 0 
0 0 0 
0 0 0 
6 0 0 
0 6 0 
0 0 6 


x 


1 

-1 

0 

0 

-1 

0 

0 


0 

0 

0 

0 

1 

1 

-1 


0 

0 

1 

-1 

0 

0 

1 


13 -6 0 

-6 18 -6 
0 -6 16 


A t WL = 


740.02 

612.72 

1072.22 


By using Equation (11.35), the solution for the X matrix is 



0.0933 

0.0355 

0.0133' 

' 740.02' 

X = N~\A t WL) = 

0.0355 

0.0133 

0.0770 

0.0289 

0.0289 

0.0733 

612.72 

1072.22 


105.150 

104.489 

106.197 


( 12 . 12 ) 
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The residual equation [Equation (12.7)] is now applied to compute the 
residuals as 


1 

0 

o' 


105.10“ 

-1 

0 

0 


-105.16 

0 

0 

1 

105.150 


106.25 

0 

0 

-1 

104.489 

— 

-106.13 

-1 

1 

0 

106.197 


-0.68 

0 

1 

0 



104.50 

0 

-1 

1 


1.70 


0.050 
0.010 
-0.053 
= -0.067 
0.019 
- 0.011 
0.008 

It should be noted that these adjusted values (X matrix) and residuals 
( V matrix) differ slightly from those obtained in the unweighted adjustment of 
Section 12.3. This illustrates the effect of weights in an adjustment. Although 
the differences in this example are small, for precise level circuits it is both 
logical and wise to use a weighted adjustment since a correct stochastic 
model will place the errors back in the observations that most likely produced 
the errors. 


12.5 REFERENCE STANDARD DEVIATION 


Equation (10.20) expressed the standard deviation for a weighted set of obser¬ 
vations as 


S 0 = 



(12.13) 


However, Equation (12.13) applies to a set of multiple observations for 
a single quantity where each observation has a different weight. Often, 
observations are obtained that involve several unknown parameters that are 
related functionally like those in Equations (12.3) or (12.9). For these types of 
observations, the standard deviation in the unweighted case is 


5 0 = 



which in matrix form is S 0 



(12.14) 
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In Equation (12.14), Ev 2 is expressed in matrix form as V T V, m the number 
of observations, and n the number of unknowns. There are r = m — n redundant 
measurements or degrees of freedom. 

The standard deviation for the weighted case is 



which in matrix form is 


*Sn = 


V T WV 


(12.15) 


where ^ wv 2 in matrix form is V T WV. 

Since these standard deviations relate to the overall adjustment and not a 
single quantity, they are referred to as reference standard deviations. Compu¬ 
tation of the reference standard deviations for both unweighted and weighted 
examples is illustrated below. 


12.5.1 Unweighted Example 

In the example of Section 12.3, there are 7-3, or 4 degrees of freedom. Using 
the residuals given in Equation (12.7) and using Equation (12.14), the reference 
standard deviation in the unweighted example is 


/ (0.041) 2 + (0.019) 2 + (-0.062) 2 + (-0.058) 2 + (0.022) 2 + (-0.017) 2 + (0.005) 2 

V 7^3 


= ±0.05 


( 12 . 16 ) 


This can be computed using the matrix expression in Equation (12.14) as 


V T V= [0.041 


0.019 -0.062 -0.058 0.022 


= 0.010 



-0.017 


0.005] 


0.041 

0.019 

-0.062 

-0.058 

0.022 

-0.017 

0.005 


/ 0.010 

V 4 


±0.05 


(12.17) 


12.5.2 Weighted Example 

Notice that the weights are used when computing the reference standard 
deviation in Equation (12.15). That is, each residual is squared and multiplied 
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by its weight, and thus the reference standard deviation computed using 
nonmatrix methods is 


3(0.050)2 + 4(0.010) 2 + 6(-0.053)2 + 4(-0.067) 2 + 6(0.019) 2 + 6(—0.011) 2 + 6(0.008) 2 


7-3 


0.04598 


= ±0.107 


(12.18) 


It is left as an exercise to verify this result by solving the matrix expression 
of Equation (12.15). 


12.6 ANOTHER WEIGHTED ADJUSTMENT 

Example 12.1 The level net shown in Figure 12.3 is observed with the 
following results (the elevation differences and standard deviations are given 
in meters, and the elevation of A is 437.596 meters): 


From 

To 

AElev (m) 

(7 (m) 

From 

To 

AElev (m) 

a (m) 

A 

B 

10.509 

0.006 

D 

A 

-7.348 

0.003 

B 

C 

5.360 

0.004 

B 

D 

-3.167 

0.004 

C 

D 

-8.523 

0.005 

A 

C 

15.881 

0.012 


What are the most probable values for the elevations of B , C, and DR 


B 



FIGURE 12.3 Differential leveling network for Example 12.1. 

SOLUTION 

Step 1: Write the observation equations without their weights: 


(1) 

+B 


= A+ 10.509 + vj 

= 448.105 + vj 

(2) 

-B 

+C 

= 5.360 + v 2 


(3) 


-c 

+£> — —8.523 + v 3 


(4) 



—D — — A — 7.348 + v 4 

= -444.944 + v 4 

(5) 

-B 


+£> = -3.167 +v 5 


(6) 


+c 

= A + 15.881 + v 6 

= 453.477 + v 6 
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Step 2: Rewrite observation equations in matrix form AX = L + V as 


1 0 

-1 1 

0 -1 
0 0 

-1 0 

0 1 


448.105 


*1 

5.360 


^2 

-8.523 

-444.944 

+ 

v 3 

^4 

-3.167 


^5 

453.477 


v 6 


(12.19) 


Step 3: In accordance with Equations (10.4) and (10.6), form the weight 
matrix as 


W = 


0.006 2 

0 

0 

0 

0 

0 


0 

1 

0.004 2 

0 

0 

0 

0 


0 

0 

1 

0.005 2 

0 

0 

0 


0 

0 

0 

1 

0.003 2 

0 

0 


0 

0 

0 

0 

1 

0.004 2 

0 


0 

0 

0 

0 

0 

1 

0 . 012 2 


( 12 . 20 ) 


From which 


27,778 0 0 

0 62,500 0 

0 0 40,000 

0 0 0 

0 0 0 

0 0 0 


0 0 0 

0 0 0 

0 0 0 

111,111 0 0 

0 62,500 0 

0 0 6944 


( 12 . 21 ) 


Step 4: Compute the normal equations using Equation (11.34) 


(. A t WA)X = NX = A t WL 


( 12 . 22 ) 



152,778 -62,500 -62,500^ 


B 

N = 

-62,500 109,444 -40,000 

X = 

C 


-62,500 -40,000 213,611 


D 


A t WL = 


12,310,298.611 
3,825,065.833 
48,899, 364.722 


where 
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Step 5: Solve for the X matrix using Equation (11.35): 


X = 


448.1087 

453.4685 

444.9436 


(12.23) 


Step 6: Compute the residuals using the matrix expression V = AX — L. 


448.1087 


448.105 


0.0037 

5.3598 


5.360 


-0.0002 

-8.5249 


-8.523 


-0.0019 

-444.9436 


-444.944 


0.0004 

-3.1651 


-3.167 


0.0019 

453.4685 


453.477 


-0.0085 


Step 7: Calculate the reference standard deviation for the adjustment using 
the matrix expression of Equation (12.15). 


V J WV= [0.0037 -0.0002 -0.0019 0.0004 0.0019 


-0.0085] 


x W 


0.0037 

- 0.0002 

-0.0019 

0.0004 

0.0019 

-0.0085 


= [1.26976] 


(12.25) 


Since the number of system redundancies is the number of observations 
minus the number of unknowns, r = 6 — 3 = 3, and thus 

S 0 = yj 126 ^ 16 = ±0.6575 (12.26) 

Step 8: Tabulate the results showing the adjusted elevation differences, then- 
residuals, and final adjusted elevations. 


From 

To 

Adjusted 

AElev 

Residual 

Station 

Adjusted 

Elevation 

A 

B 

10.513 

0.004 

A 

437.596 

B 

C 

5.360 

0.000 

B 

448.109 

C 

D 

-8.525 

-0.002 

C 

453.468 

D 

A 

-7.348 

0.000 

D 

444.944 

B 

D 

-3.165 

0.002 



A 

C 

15.872 

-0.009 
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12.7 SOFTWARE 


The example files presented in this chapter are solved in spreadsheet format 
in the file Chapter 12. xls, which is available on the companion website for this 
book. This file demonstrates how least squares solutions can be solved in a 
spreadsheet. Additionally, for Example 12.1 an example of the data created in 
the spreadsheet is set up for copying to the MATRIX software, which is also 
available on the website. This file is shown in Figure 12.4. All of the examples 
shown in this chapter are solved in the Mathcad 8 file C12.xmcd, which are 
available on the companion website. This file demonstrates how to solve 
differential leveling problems using a higher-level programming language. For 
Example 12.1, the file shows how to read a differential leveling and create 
formatted results in Mathcad . 

Furthermore, files for solving Example 12.1 in MATRIX and ADJUST 
are available on the companion website. The data files for both programs are 
simple text files with specific formats, which can be created with the editors 
supplied in each program. The data file for MATRIX is called Matrix file for 
Example 12-1.Mdat and is shown in Figure 12.4. It has the following format. 
The first line is a title line and can contain any description up to 80 characters 
in length. The second line contains the name of the first matrix, which is A in 
this file. This is followed by the dimensions of the matrix, then each row of the 
A matrix. Following the entry of the A matrix, the weight matrix W and con¬ 
stants matrix L are entered in a similar fashion. A space delimits each entry 
in the file. These entries can also be delimited by a tab or comma. The tab is a 
common delimiter for data copied from a spreadsheet. This feature allows for 
quick solution of least squares problems. 

Example 12.1 
A 

6 3 
10 0 
-110 
0-11 
0 0-1 
-10 1 
0 10 
W 

6 6 

27777.77778 00000 
0 62500 0000 
0 0 40000 000 
000 111111.1111 0 0 
0000 62500 0 
00000 6944.444444 
L 

6 1 

448.105 

5. 360 

-8.523 

-444.944 

-3.167 

453.477 


FIGURE 12.4 MATRIX file for Example 12.1. 
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Example 12.1 


1 

6 

4 


A 

437.596 


A 

B 

10.509 

0.006 

B 

C 

5.360 

0.004 

C 

D 

-8.523 

0.005 

D 

A 

-7.348 

0.003 

B 

D 

-3.167 

0.004 

A 

C 

15.881 

0.012 


FIGURE 12.5 ADJUST file for Example 12.1. 


Figure 12.5 shows the format for ADJUST file used to solve Example 12.1. 
The format of this file is a file description line, followed by a line contain¬ 
ing the number of control bench marks, elevation differences, and the total 
number of stations in the file. Following these lines are lines containing the 
control bench mark identifiers and elevations. All station identifiers in this file 
can have 10 alphanumeric characters, but may not contain a space, comma, 
or tab, which are reserved as delimiters between entries in the file. Following 
the entry of control bench marks, the observed elevation differences are listed. 
Each elevation difference is entered as I J AElev, which is the from station, 
to station, and observed difference in elevation. When the standard deviation, 
number of setups between stations, or distance between stations is known, 
it can be entered at the end of each observation’s line for use in a weighted 
adjustment. Once this file is saved, the differential leveling least squares adjust¬ 
ment option can be run from the programs menu of ADJUST. As shown in 
Figure 12.6, you can select the appropriate adjustment options for the data. 


it Differential Least Squares — □ X 

Adjustment Options 
I - Estan ces fair W eights ] 
r Adj Observation Errors 
r Adjust Control Stations 
r Std dev inAdj Sta 
1% of radial error 
T F test |o 05 

✓ OK | 

X Cancel | 

P Simulation ? Help I 


Blunder Detection 
(' Data snooping 
C Jau criterion 

I - Pnnt Matnces 


FIGURE 12.6 Differential leveling least squares options in ADJUST. 
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If distances or the number of setups is used to develop a stochastic model in 
a weighted adjustment, the first option in Figure 12.6 should be selected. If 
standard deviations or an unweighted adjustment is desired, the first option 
should not be selected. Many of the remaining options for this program will be 
discussed in later chapters. However, if the print matrices option is selected, the 
software will create a separate hie having a mat extension, which will contain 
several matrices including the A and L. These matrices can be used to check 
those developed by the reader in the solution of a problem. 

PROBLEMS 

Note: For problems requiring least squares adjustment, if a computer program 
is not distinctly specified for use in the problem, it is expected that the least 
squares algorithm will be solved using the program MATRIX, which is 
available on the companion website for this book. Partial answers to problems 
marked with an asterisk can be found in Appendix H. 

*12.1 For the leveling network in the accompanying figure calculate the most 
probable elevations for X and Y. Use an unweighted least squares 
adjustment with the observed values given in the accompanying table. 
Assume units of feet. 


Line 

AElev (ft) 

1 

+3.68 

2 

+2.06 

3 

-2.02 

4 

-2.37 

5 

-0.38 



*12.2 For Problem 12.1, compute the reference standard deviation and tabu¬ 
late the adjusted observations and their residuals. 
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12.3 Repeat Problem 12.1 using ADJUST. 

12.4 For the leveling network shown in the accompanying figure, calculate 
the most probable elevations for X, Y, and Z. The observed values and 
line lengths are given in the table. Apply appropriate weights in the 
computations. 


Line 

AElev (ft) 

Length (ft) 

1 

+13.46 

2300 

2 

-16.48 

2300 

3 

-11.32 

1300 

4 

+8.35 

1300 

5 

+3.01 

1250 

6 

-3.00 

400 


BM 0= 100.00 ft 



12.5 For Problem 12.4, compute the reference standard deviation, and 
tabulate the adjusted observations and their residuals. 

12.6 Repeat Problem 12.4 and 12.5 using the following standard deviations 
for the lines. 


Line 

S (ft) 

1 

±0.031 

2 

±0.031 

3 

±0.025 

4 

±0.025 

5 

±0.016 

6 

±0.025 


(a) Tabulate the most probable values for the adjusted bench marks. 

(b) Tabulate the adjusted observations and their residuals. 

(c) What is the reference standard deviation for the adjustment? 
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12.7 Repeat Problem 12.6 for the following set of data. 


Line 

AElev (m) 

S (mm) 

Line 

AElev (m) 

S (mm) 

1 

26.330 

±7.9 

4 

-22.280 

±5.6 

2 

-33.560 

±7.9 

5 

7.040 

±3.6 

3 

15.120 

±5.6 

6 

-6.970 

±5.6 


*12.8 A line of differential level is run from bench mark Oak (elevation 
753.01) to station 13+00 on a proposed alignment. It continued along 
the alignment to 19+00. Rod readings were taken on stakes at each 
full station. The circuit then closed on bench mark Bridge having an 
elevation of 764.95 ft. The observed elevation differences, in order, 
are -3.03, 4.10, 4.03, 7.92, 7.99, -6.00, -6.02, and 2.98 ft. A third tie 
between bench mark Rock (elevation of 772.39 ft) and station 16+00 
is observed as -6.34 ft. What are the 

(a) Most probable values for the adjusted elevations? 

(b) Reference standard deviation for the adjustment? 

(c) Adjusted observations and their residuals? 

12.9 Use ADJUST to solve Problem 12.8. 

12.10 Repeat Problem 12.8 using the differences in elevation between Oak 
(5034.56 ft) and Bridge (5039.88 ft) of-4.23, 2.73, -1.50, -2.50, 5.81, 
1.18, 1.61, 2.16, and the elevation difference between Rock (5016.79 ft) 
and station 1600 is 12.25. 

12.11 Repeat Problem 12.10 using standard deviations for each observation 
of ±0.015, ±0.011, ±0.011, ±0.011, ±0.011, ±0.011, ±0.011, ±0.011, 
and ±0.016, respectively. 

12.12 If the elevation of A is 1302.243 m, adjust the following leveling data 
using the weighted least squares method. 


From 

To 

AElev (m) 

S (mm) 

A 

B 

20.846 

±6.0 

B 

C 

2.895 

±4.9 

C 

D 

6.888 

±4.9 

D 

E 

-4.254 

±4.9 

E 

F 

-4.498 

±6.0 

F 

G 

-2.667 

±4.9 

G 

A 

-19.194 

±4.9 

A 

C 

23.737 

±6.9 

C 

F 

-1.876 

±8.4 

F 

D 

8.765 

±6.0 
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(a) What are the most probable values for the elevations of the 
stations? 

(b) What is the reference standard deviation? 

(c) Tabulate the adjusted observations and their residuals. 

12.13 Use ADJUST to solve Problem 12.12. 

12.14 Repeat Problem 12.12 using the following observations and an eleva¬ 
tion for A of 3456.98 ft. 


From 

To 

AElev (ft) 

S( ft) 

A 

B 

-3.91 

±0.016 

B 

C 

-3.73 

±0.016 

C 

D 

1.96 

±0.011 

D 

E 

0.80 

±0.011 

E 

F 

3.57 

±0.011 

F 

G 

2.72 

±0.011 

G 

A 

-1.38 

±0.011 

A 

C 

-7.62 

±0.016 

C 

F 

6.32 

±0.016 

F 

D 

-4.37 

±0.016 


12.15 If the elevation of Station 1 is 342.384 m, use weighted least squares to 
adjust the following leveling. 


From 

To 

AElev (m) 

S (m) 

From 

To 

AElev (m) 

S (m) 

1 

2 

-6.767 

±0.004 

2 

3 

15.232 

±0.004 

3 

4 

33.095 

±0.007 

4 

5 

-11.873 

±0.004 

5 

6 

-8.450 

±0.005 

6 

1 

-21.230 

±0.004 

1 

7 

6.002 

±0.004 

7 

3 

2.446 

±0.007 

2 

7 

12.785 

±0.006 

7 

6 

15.222 

±0.003 

6 

3 

-12.776 

±0.007 

3 

8 

-9.745 

±0.007 

8 

5 

30.956 

±0.008 

6 

8 

-22.519 

±0.007 

8 

4 

42.844 

±0.009 






(a) What are the most probable values for the elevations for the 
stations? 

(b) What is the adjustment’s reference standard deviation? 

(c) Tabulate the adjusted observations and their residuals. 
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12.16 Use ADJUST to solve Problem 12.15. 

12.17 Precise procedures were applied with a level that can be read to within 
±0.4 mm/1 m and had a bubble sensitivity of ±0.3". The line of sight 
was held to within ±1" of horizontal, and the sight distances were 50 ± 
3 m in length. Use these specifications and Equation (9.20) to compute 
standard deviations and hence weights. The elevation of A is 235.896 
m. Adjust the network by weighted least squares. 


From 

To 

AElev 

(m) 

Number 
of Setups 

From 

To 

AElev 

(m) 

Number 
of Setups 

A 

B 

12.383 

15 

M 

D 

-38.238 

42 

B 

C 

-16.672 

18 

C 

M 

30.338 

39 

C 

D 

-7.903 

25 

M 

B 

-13.676 

23 

D 

A 

12.190 

53 

A 

M 

26.058 

30 


(a) What are the most probable values for the elevations of the 
stations? 

(b) What is the reference standard deviation for the adjustment? 

(c) Tabulate the adjusted observations and their residuals. 

12.18 Repeat Problem 12.17 using the number of setups for weighting follow¬ 
ing procedures discussed in Section 10.6. 

12.19 In Problem 12.17, the estimated error in reading the rod is 1.5 mm/ 
100 m. The bubble sensitivity of the instrument is 1 mm/km and the 
average sight distances are 150 ft using Equation (9.21). What are the 

(a) Estimated standard errors for the observations? 

(b) Most probable values for the elevations of the stations? 

(c) Reference variance for the adjustment? 

(d) Tabulate the adjusted observations and their residuals. 

12.20 Demonstrate that £v 2 = V T V. 

12.21 Demonstrate that ^wv 2 = V T WV. 

PROGRAMMING PROBLEMS 

12.22 Write a program that reads a hie of differential leveling observations 
and writes the matrices A, W, and L in a format suitable for the 
MATRIX program. Using this package, solve Problem 12.14. 
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12.23 Write a computational package that reads the matrices A, W, and L, 
computes the least squares solution for the unknown station elevations, 
and writes a hie of adjusted elevation differences and their residuals. 
Using this package, solve Problem 12.14. 

12.24 Write a computational package that reads a hie of differential leveling 
observations, computes the least squares solution for the adjusted sta¬ 
tion elevations, and writes a hie of adjusted elevation differences and 
their residuals. Using this package, solve Problem 12.14. 


CHAPTER 13 


PRECISIONS OF INDIRECTLY 
DETERMINED QUANTITIES 


13.1 INTRODUCTION 

Following an adjustment, it is important to know the estimated errors in 
both the derived quantities and the adjusted observations. For example, after 
adjusting a level net as described in Chapter 12, the uncertainties in both 
computed bench mark elevations and adjusted elevation differences can be 
determined. In Chapter 5, error propagation formulas were developed for 
indirectly measured quantities that were functionally related to observed 
values. In this chapter, error propagation formulas are developed for the 
quantities computed in a least squares solution. 


13.2 DEVELOPMENT OF THE COVARIANCE MATRIX 

Consider an adjustment involving weighted observation equations like 
those in the level circuit example of Section 12.4. The matrix form for the sys¬ 
tem of weighted observation equation is 

WAX = WL + WV (13.1) 

and the least squares solution of the weighted observation equations is 
given by 

X = {A t WA)~ 1 A t WL (13.2) 

245 
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In this equation, X contains the most probable values for the unknowns, 
whereas the true values are X true . The true values differ from A by some small 
amount AX, such that 

X + AX - X lrue (13.3) 

where AX represents the true errors in the adjusted values. 

Consider now a small incremental change, A L, in the observed values, L, 
which changes X to its true value, X + AX. Then Equation (13.2) becomes 

X + AX = (A T WA)~ 1 A T W(L + AL) (13.4) 

Expanding Equation (13.4) yields 

X + AX = (A t WA)- 1 A t WL + (A t WA)~ 1 A t WAL (13.5) 

Note in Equation (13.2) that X = (A T WA)~ 1 A r WL, and thus, subtracting 
this from Equation (13.5) yields 

AX = (A t WA)- , A t WAL (13.6) 

Recognizing AL as the errors in the observations, Equation (13.6) can be 
rewritten as 

AX = (A t WA)~ 1 A t WV (13.7) 

where the vector of residuals V is substituted for AL. Now let 

B = (A T fVAy 1 A T W (13.8) 


Then 


AX = BV 


(13.9) 


Multiplying both sides of Equation (13.9) by their transposes results in 

AXAX J = (BV){BV) J (13.10) 

Applying the matrix property (BV) r = V J B J to Equation (13.10) yields 

AXAX J = BVV J B r (13.11) 

The expanded left side of Equation (13.11) is 



fN — 

K 

< 

i_ 

Aa'| Ax 2 

AX| Ax 3 • 

• AxjAx 


Aa' 2 Axj 

Ax; 

Ax 2 Ax 3 • 

• Ax 2 Ax 

axax t = 

A.\' 3 A.\‘i 

A.X3AX2 

A.Xj 

■ Ax 3 Ax 


A.t„A.Vi 

Ax n Ax 2 

Ax„Ax 3 • 

• Ax -2 
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Also, the expanded right side of Equation (13.11) is 


VI 

ViV 2 

V1V3 • 

’ VlV,n 



V 2 Vi 

V 2 

2 

V 2 V 3 • 

■ v 2 v m 



V3V1 

v 3 v 2 

i • 

■ v 3 v m 

b t 

(13.13) 

V m Vl 

V 2 

V 3 • 

v 2 

y m 




Assume that it is possible to repeat the entire sequence of observations many 
times, say a times, and that each time a slightly different solution occurs, yield¬ 
ing a different set of Xs. Averaging these sets, the left side of Equation (13.11) 
becomes 


- TtAXXAX ) 1 

n 


X Ax \ Z Ax l Aa '2 X Ax l Ax n 


Z Aa cAa-, ^ Ax 


Z Ax » A *i Z Ax » Ax 2 


Z A.y 2 A X„ 


Z Ax » 


(13.14) 


If a is large, the terms in Equation (13.14) are the variances and covariances 
as defined in Equation (6.7), and Equation (13.14) can be rewritten as 


Si S x _ 

X 1 x l x 2 

s r . r . si 


Vl V2 


Sx c 

s r _ 


= Si 


(13.15) 


Also, considering “ a ” sets of observations, Equation (13.13) becomes 

Z v i Z v i v 2 z 


B 


, ViV, 


1 v m 


a 

a 

a 

Z V 2 V 1 


X V 2 V m 

a 

a 

a 

Z v '» v i 

Z V ™ V 2 

y y 2 

/ j tn 

a 

a 

a 


B' 


(13.16) 
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Recognizing the diagonal terms as variances of the quantities observed, 
S 2 off-diagonal terms as the covariances, S N , and the fact that the matrix is 
symmetric, Equation (13.16) can be rewritten as 


B 




S 


‘mh 


S, i 

l m l 2 



(13.17) 


In Section 10.1, it was shown that the weight of an observation is inversely 
proportional to its variance. Also, from Equation (10.5), the variance of an 
observation of weight w can be expressed in terms of the reference variance as 


2 S 0 

S 2 = — (13.18) 

Wi 


Recall from Equation (10.3) that W = Q~ x = . Therefore, X = a 2 W~ x , 

and by substituting Equation (13.18) into matrix (13.17) and replacing a 0 with 
S 0 yields 

S 2 0 BW~'B t (13.19) 

Substituting Equation (13.8) into Equation (13.19) gives 

S 2 0 BW~ l B r = S 2 0 (A J WAr'A T WW- x W J [(A J WA)-'] J (13.20) 


Since the normal and weight matrices are symmetric, it follows that 

[U t 0H) -1 ] T = (A T mr 1 (13.21) 

Also, since the weight matrix W is symmetric, W T = W, and thus 
Equation (13.20) reduces to 


S 2 (A T WAy 1 (A T WA)(A T WAr 1 = S 2 (A T WA)~ ] (13.22) 

Equation (13.15) is the left side of Equation (13.11), for which 
Equation (13.22) is the right. That is, 

^ = S 2 (A t WA)- 1 = S 2 0 N- x = Sq Q xx (13.23) 

In least squares adjustment, the matrix of Equation (13.23) is known 
as the variance-covariance matrix, or simply the covariance matrix, and Q xx is 
the cofactor matrix for the adjusted unknown parameters. Diagonal elements 
of the cofactor matrix when multiplied by S 2 yield variances of the adjusted 
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quantities, and the off-diagonal elements multiplied by S~ yield covariances. 
From Equation (13.23), the estimated standard deviation .S', for any unknown 
parameter having been computed from a system of observation equations is 
expressed as 

S t = S 0 ^ (13.24) 

where q x x is the diagonal element (from the zth row and zth column) of the 
Q xx matrix, which as noted in Equation (13.23), is equal to the inverse of the 
matrix of normal equations. Since the normal equation matrix is symmetric, 
its inverse is also symmetric, and thus the covariance matrix for the adjusted 
unknown parameters, S xx = S~Q XX , is also a symmetric matrix (i.e., element 
ij = element ji). 

Note that an estimate for the reference variance, tr 2 , may be computed using 
either Equation (12.14) or (12.15), depending on whether the observations are 
unweighted or weighted. Elowever, it should be remembered that this is only an 
estimate for the a priori (before the adjustment) value of the reference variance. 
The validity of this estimate can be checked using a x 2 test as discussed in 
Chapter 5. If it is a valid estimate for a 2 the a priori value for the reference 
variance, which is 1 typically, 1 can and should be used in the post-adjustment 
statistics computations discussed in this and the following chapters. Thus, the 
reference variance computed from the adjustment, S 2 , should be used only 
when the null hypothesis of the / 2 test is rejected. Elowever, many software 
packages always use the computed reference variance rather than the a priori 
value. When the / 2 test fails to reject the null hypothesis and the a priori 
reference variance is not used in the computations, this typically only causes 
small differences in the computed statistical values. Thus, it is considered valid 
to use the a posteriori (after the adjustment) value for the reference variance 
in the post-adjustment statistical computations. 


13.3 NUMERICAL EXAMPLES 


The results of the level net adjustment in Section 12.3 will be used to illus¬ 
trate the computation of estimated errors for the adjusted unknowns. From 
Equation (12.6), the N~ ] matrix, which is also the Q xx matrix, is 


Qxx 


0.38095 0.14286 0.04762 
0.14286 0.42857 0.14286 
0.04762 0.14286 0.38095 


'When weights are determined as l/ff 2 , the implicit assumption is that the a priori reference 
variance value for c 2 is 1. 
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Also, from Equation (12.17), S 0 = ±0.05. Now by Equation (13.24), the 
estimated standard deviations for the unknown bench mark elevations A, B , 
and C are 


S A = = ±0.05 Vo.38095 = ±0.031 ft 

S B = SoyJq^B = ±0.05Vo.42857 = ±0.033 ft 
S c = S 0 ^- c = ±0.05 Vo.38095 = ±0.031 ft 

In the weighted example of Section 12.4, it should be noted that although 
this is a weighted adjustment, the a priori value for the reference variance is 
not known because weights were determined as 1/distance and not 1/crr where 
V was set equal to 1. From Equation (12.12), the Q xx matrix is 


Q 


xx 


0.0933 0.0355 0.0133 
0.0355 0.0770 0.0289 
0.0133 0.0289 0.0733 


Recalling that in Equation (12.18) 5 0 = ±0.107, the estimated errors in the 
computed elevations of bench marks A , 5, and C are 

S A = S 0 ^- A = ±0.107V0.0933 = ±0.033 ft 
S B = S 0 y/q^} = ±0.107 V0-0770 = ±0.030 ft 
S c = So^Jq^ = ±0.107V0.0733 = ±0.029 ft 

These standard deviations are at approximately the 68% probability level, and 
if other percentage errors are desired, these values should be multiplied by their 
respective t values as discussed in Chapter 3. 

It should be noted that in the weighted example, if variances had been used 
to compute the weights as 1 /rr 2 , then a / 2 test could have been performed to 
check if the computed reference variance S~ was statistically equal to c 2 . If they 
were determined to be statistically equal, that is H 0 is not rejected, then the a 
priori value for er 2 of one can be substituted for S~ in Equation (13.23). 


13.4 STANDARD DEVIATIONS OF COMPUTED QUANTITIES 

oped. Recalled here for convenience, Equation (6.13) was written as 

Z n =AY xx A J 


In Section 6.1 , the generalized law of propagation of variances was devel- 


(a) 
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where / represents the adjusted observations, E# the covariance matrix of the 
adjusted observations, Z xx the covariance matrix of the unknown parameters 
[i.e., <jIQ xx ], and A the coefficient matrix of the observations. Rearranging 
Equation (10.2) and using sample statistics, there results Z xx = S^Q XX . Also 
from Equation (13.23), S xx = S^Q XX = S^(A T WA)~ 1 , and thus E AA . = S xx 
where S xx is an estimate for E xx . Substituting this equality into Equation (a), 
the estimated standard deviations of the adjusted observations are 

%=% = AE xx A t = ASq(A t WA) _1 A t = SqAQ xx A t = SlQ n (13.25) 
where AQ xx A r = Qjj is the cofactor matrix of the adjusted observations. 


Example 13.1 Consider the unweighted leveling adjustment in Section 12.3. 
By Equation (13.25), the estimated standard deviations in the adjusted eleva¬ 
tion differences are given by 


1 

0 

o' 




-1 

0 

0 




0 

0 

1 

0.38095 

0.14286 

0.04762 

0 

0 

-1 

0.14286 
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-1 
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0.38095 
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1 

0 




0 

-1 

1 
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1 

0 

0 


-1 

0 

0 


0 0 

0 0 

1 -1 


-10 0 
1 1 -1 

0 0 1 


(13.26) 


Performing the required matrix multiplications in Equation (13.26) yields 
Sr = 0.050 2 


0.38095 

-0.38095 

0.04762 

-0.04762 

-0.23810 

0.14286 

-0.09524' 

-0.38095 

0.38095 

-0.04762 

0.04762 

0.23810 

-0.14286 

0.09524 

0.04762 

-0.04762 

0.38095 

-0.38095 

0.09524 

0.14286 

0.23810 

-0.04762 

0.04762 

-0.38095 

0.38095 

-0.09524 

-0.14286 

-0.23810 

-0.23810 

0.23810 

0.09524 

-0.09524 

0.52381 

0.28571 

-0.19048 

0.14286 

-0.14286 

0.14286 

-0.14286 

0.28571 

0.42857 

-0.28571 

-0.09524 

0.09524 

0.23810 

-0.23810 

-0.19048 

-0.28571 

0.52381 


(13.27) 

The estimated standard deviation of an observation is found by taking the 
square root of the corresponding diagonal element of the covariance matrix Sr 
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(leveling from A to B). For instance, for the fifth observation, ,S}(5,5) applies and 
the estimated error in the adjusted elevation difference of that observation is 

S AAB = ±0.050 Vo.52381 = ±0.036 ft 


An interpretation of the meaning of the value just calculated is that there is a 
68% probability that the true value is within the range ±0.036 ft of the adjusted 
elevation difference (/ 5 + v 5 = -0.68 + 0.022 = -0.658). That is, the true value 
lies between -0.658 ± 0.036 (-0.694, -0.622) with 68% probability. 

Careful examination of the matrix manipulations involved in solving 
Equation (13.25) for Example 13.1 reveals that the effort can be reduced 
significantly. In fact, to obtain the estimated standard deviation in the fifth 
element, only the fifth row of the coefficient matrix. A, which represents 
the elevation difference between A and B, need be used in the calculations. 
That row is [-1 1 0], Thus, to determine the standard deviation in this 

observation, the following computations could be made: 


SIab = °-050 2 [-1 


'0.38095 

0.14286 

0.04762' 

'-f 

0.14286 

0.42857 

0.14286 

1 

0.04762 

0.14286 

0.38095 

0 


= 0.050 2 [0.23809 -0.28571 


-0.09524] 


-1 

1 

0 


= 0.050 2 [0.52381] 


Saab = ±0.050V0.52381 = ±0.036 ft 


(13.28) 


Note that this shortcut method produces the same value. Furthermore, 
because of the zero in the third position of this row from the coefficient matrix, 
the matrix operations in Equation (13.28) could be further reduced to 


J AAB 


0.050 



0.38095 0.14286' 

-1 

-1 1] 

0.14286 0.42857 

1 


= 0.050 2 [0.52381] 


Another use for Equation (13.25) is in the computation of adjusted uncer¬ 
tainties for observations that were never made. For instance, in the example 
of Section 12.3, the elevation difference between bench marks X and B was 
not observed. But from the results of the adjustment, this elevation difference 
is 104.48 - 100.00 = 4.48 ft. The estimated error in this difference can be 
found by writing an observation equation for it (i.e., B = X + A Elev XB ). 
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This equation does not involve either A or C, and thus in matrix form this 
difference would be expressed as 


[0 1 0 ] 


(13.29) 


Using this row matrix in the same process as shown in Equation (13.28) 
yields 


S 2 axb = 0.050 2 [0 


0.38095 

0.14286 

0.04762 

'o' 

0.14286 

0.42857 

0.14286 

1 

0.04762 

0.14286 

0.38095 

0 


0.050 2 [0.42857] 


Hence, 

S AXB = ±0.050Vo.42857 = ±0.033 ft 

Again, recognizing the presence of the zeros in the row matrix, these com¬ 
putations can be simplified to 

S 2 axb = 0.050 2 [1][0.42857][1] = 0.050 2 [0.42857] 

The method illustrated above of eliminating unnecessary matrix computations 
is formally known as matrix partitioning. 


Computing uncertainties of quantities that were not actually observed has 
application in many areas. For example, suppose in a triangulation adjust¬ 
ment, that the x and y coordinates of stations A and B are calculated and 
the covariance matrix exists. Equation (13.25) could be applied to determine 
the estimated error in the length of line AB calculated from the adjusted 
coordinates of A and B. This is accomplished by relating the length AB to the 
unknown parameters as 


AB =yJ{X b - XJ 2 + (Y b - YJ 2 (13.30) 

This subject is discussed further in Chapter 14. 

An important observation that should be made about the Qjj and Q xx 
matrices is that only the coefficient matrix. A, is used in their formation. 
Since the A matrix contains coefficients that express the relationships of the 
unknowns to each other, it depends only on the geometry of the problem. The 
only other term in Equation (13.25) is the reference variance, and that depends 
on the quality of the observations. These are important concepts that will be 
revisited in Chapter 21 when simulation and design of surveying networks 
is discussed. 
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PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

13.1 The reference variance of an adjustment is 1.23. The cofactor matrix 
and unknown parameter matrix are 


'0.6803 

0.2356 

0.1137' 


~A 

0.2356 

0.5431 

-0.1678 

X = 

B 

0.1137 

-0.1678 

0.5692 


C 


What is the estimated error in the adjusted value for 
*(a) A? 

(b) B ? 

(c) C? 

13.2 In Problem 13.1, the adjustment had nine degrees of freedom. 

*(a) Did the adjustment pass the x 2 test at a 95% confidence level? 
(b) Assuming it passed the / 2 test in part a, what would be the esti¬ 
mated errors in the adjusted parameters? 

For Problems 13.3 to 13.8, determine the estimated errors in the adjusted 
elevations: 

*13.3 Problem 12.1. 

13.4 Problem 12.4. 

13.5 Problem 12.6. 

13.6 Problem 12.8. 

13.7 Problem 12.10. 

13.8 Problem 12.11. 

For each problem, calculate the estimated errors for the adjusted elevation 
differences. 

*13.9 Problem 12.1. 

13.10 Problem 12.4. 

13.11 Problem 12.6. 

13.12 Problem 12.8. 

13.13 Problem 12.11. 
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13.14 Calculate the adjusted length AD and its estimated error given the 
accompanying sketch and observational data below (Assume equal 
weights). 


*A- 




-A* 




FIGURE P13.14 


Length Observations 

/j = 100.01 l 2 = 200.00 / 3 = 300.02 / 4 = 99.94 l 5 = 200.02 l 6 = 299.98 

13.15 Use the accompanying sketch and the data below to answer the follow¬ 
ing questions. 



FIGURE P13.15 
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Elevation of BM A = 1060.00 ft Elevation of BM B=\ 125.79 ft 


Obs 

From 

To 

AElev (ft) 

a (ft) 

Obs 

From 

To 

AElev (ft) 

a (ft) 

1 

BM A 

V 

12.33 

±0.018 

8 

Y 

Z 

3.51 

±0.022 

2 

BM B 

V 

-53.46 

±0.019 

9 

W 

z 

58.84 

±0.022 

3 

V 

X 

-6.93 

±0.016 

10 

V 

w 

-28.86 

±0.021 

4 

V 

Y 

26.51 

±0.021 

11 

BM A 

w 

-16.52 

±0.017 

5 

BM B 

Y 

-27.09 

±0.017 

12 

BM B 

X 

-60.36 

±0.020 

6 

BM A 

X 

5.38 

±0.021 

13 

W 

X 

21.86 

±0.018 

7 

Y 

X 

-33.50 

±0.018 

14 

X 

z 

36.90 

±0.020 


What is the 

(a) Most probable elevation for each of stations V, W, X, Y, and Z? 

(b) Estimated error in each elevation? 

(c) Adjusted observations, their residuals, and estimated errors? 

(d) Elevation difference from bench mark A to station Z and its esti¬ 
mated error? 

13.16 Do a x 1 test i n Problem 13.15. What observation might contain a 
blunder? 

13.17 Repeat Problem 13.15(a) - (c) without observation 5. 

13.18 Repeat Problem 13.15(a) - (c) without observations 3, 5, and 11. 

13.19 Repeat Problem 13.17 without observations 7 and 13. 

13.20 Use the ADJUST to do Problems 13.17, 13.18, and 13.19. Explain any 
differences in the adjustment results. 


PROGRAMMING PROBLEMS 

13.21 Adapt the program developed in Problem 12.17 to compute and 
tabulate the adjusted. 

(a) Elevations and their estimated errors. 

(b) Elevation differences and their estimated errors. 

13.22 Adapt the program developed in Problem 12.18 to compute and 
tabulate the adjusted. 

(a) Elevations and their estimated errors. 

(b) Elevation differences and their estimated errors. 







CHAPTER 14 


ADJUSTMENT OF HORIZONTAL 
SURVEYS: TRI LATE RATI ON 


14.1 INTRODUCTION 

Horizontal surveys are performed for the purpose of determining precise 
relative horizontal positions of points. They have traditionally been accom¬ 
plished by trilateration, triangulation, and traverse. These traditional types of 
surveys involve making distance, direction, and angle observations. As with all 
types of surveys, errors will occur in making these observations, and thus, they 
must be analyzed and, if acceptable, adjusted. The following three chapters 
describe procedures for adjusting trilateration, triangulation, and traverse 
surveys, in that order. 

Recently, the global navigation satellite systems (GNSSs), such as GPS, 
have gradually been replacing these traditional procedures for conducting 
precise surveys. In fact, GNSS surveys not only yield horizontal positions but 
give ellipsoidal heights as well. Thus, GNSS surveys provide three-dimensional 
surveys. Again, as with all observations, GNSS surveys contain errors and 
must be adjusted. In Chapter 17 we discuss the subject of GNSS surveying 
in more detail and illustrate methods for adjusting networks surveyed by this 
procedure. 

Horizontal surveys, especially those covering a large extent, must account for 
the systematic effects of Earth curvature. One way this can be accomplished is 
to do the computations using coordinates from a mathematically rigorous map 
projection system such as the state plane coordinate system (SPCS), universal 
transverse Mercator (UTM) system, or a local plane coordinate system that 
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rigorously accounts for Earth curvature. 1 In the following chapters, methods 
are developed for adjusting horizontal surveys using parametric equations that 
are based on plane coordinates. In Chapter 23, a three-dimensional geodetic 
network adjustment is developed for traditional surveying observations, 
including differential leveling, slant distances, and vertical angles. 

It should be noted that if state plane coordinates are used, the numbers 
are usually rather large. Consequently, when they are used in mathematical 
computations, errors due to rounding and truncation can occur. This can be 
prevented by translating the origin of the coordinates prior to adjustment, a 
process that simply involves subtracting a constant value from all coordinates. 
Then after the adjustment is finished, the true origin is restored by adding 
the constants to the adjusted values. This procedure is demonstrated with the 
following example. 

Example 14.1 Assume that the NAD 83 state plane coordinates of three 
control stations to be used in a horizontal survey adjustment are as given 
below. Translate the origin. 


Point 

Easting (m) 

Northing (m) 

A 

698,257.171 

172,068.220 

B 

698,734.839 

171,312.344 

C 

698,866.717 

170,696.617 


SOLUTION 

Step 1: Many surveyors in the United States prefer to work in feet and some 
jobs require it. Thus, in this step the eastings and northings, respectively, 
are converted to X and Y values in feet by multiplying by the appropriate 
exact conversion value. The factor for converting meters to US survey 
feet is based on there being exactly 39.37 inches per meter. After making 
the multiplications, the coordinates in feet are 


Point 

A (ft) 

Y (ft) 

A 

2,290,865.40 

564,527.15 

B 

2,292,432.55 

562,047.25 

C 

2,292,865.22 

560,027.15 


Step 2: To reduce the sizes of these numbers, an X constant is subtracted 
from each X coordinate and a Y constant is subtracted from each Y 
coordinate. For convenience, these constants are usually rounded to the 

1 Map projection systems are presented in Appendix F. 
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nearest thousands of units and are normally selected to give the smallest 
possible coordinates without producing negative values. In this instance, 
2,290,000 ft and 560,000 ft are used as the X constant and Y constant, 
respectively. Subtracting these values from the coordinates yields 


Point X (ft) T (ft) 


A 865.40 4,527.15 

B 2,432.55 2,047.25 

C 2,865.22 27.15 


These X’ and Y’ coordinates can then be used in the adjustment. After the 
adjustment is complete, the coordinates are translated back to their state plane 
values by reversing the steps described above, that is, by adding 2,290,000 ft to 
all adjusted X coordinates and adding 560,000 ft to all adjusted Y coordinates. 
If desired, they can be converted back to meters, also. 

In the horizontal adjustment problems solved later in this book, either 
translated state plane coordinates or local plane coordinates are used. In this 
chapter, we concentrate on adjusting trilateration surveys, those involving 
only horizontal distance observations. This method of conducting horizontal 
surveys became common with the introduction of EDM instruments that 
enabled accurate distance observations to be made rapidly and economically. 
Trilateration is still possible using today’s modern total station instruments, 
but as noted, the procedure is now giving way to traversing, networks, and 
GNSS surveys. 


14.2 DISTANCE OBSERVATION EQUATION 

^3 In adjusting trilateration surveys using the parametric least squares 
method, observation equations are written that relate the observed quantities 
and their inherent random errors to the most probable values for the x and y 
coordinates (the parameters) of the stations involved. Referring to Figure 14.1, 
the following distance equation can be written for any observation /,y 



(14.1) 


In Equation (14.1), /,y is the observed distance of a line between stations / 
and /, Vj the residual in the observation L, x h y t the most probable coordinate 
values for station /, and Xj, yj the most probable coordinate values for station./. 
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Equation (14.1) is a nonlinear function involving the unknown parameters x h 
v ; , Xj, and y -, that can be rewritten as 

F(Xi,yi, Xj,yj) = ly + v, (14.2) 

where F{x i ,y i ,x j ,y j ) = ^/(Xj - x,) 2 + - y{) 2 . 

As discussed in Section 11.10 and demonstrated in Appendix C, a system 
of nonlinear equations such as Equation (14.2) can be linearized and solved 
using a first-order Taylor series approximation. The linearized form of 
Equation (14.2) is 


F(Xj,y h Xj,yj) = F(x k ,y k ,x k , y Jo ) + 


dFj\ 
dxt) o 
dF\ 


dx t + ( — ] dy t 


+ ( —- ) dX: + 


dx ]Jn~’ J \ d y >7 ' 


dy,) ( 


dy,- (14.3) 


h/o 


where (dF/dx^Q, (dF/dy^Q, (dF/dX:) () , and (dF/dyj) 0 are the partial deriva¬ 
tives of F with respect to x h y t , x-, and y-, respectively, evaluated with 
the approximate coordinate values x io ,y io ,x k , andy /o ; x t , y r Xj, and Vj 
are the unknown parameters; and dx h dy r dx-, and dyj the corrections to 
the approximate coordinate values such that 


Xt = x io + dXj y t = y io + dy f 

Xj = x jo + dxj yj = y ja + dyj (14.4) 

The evaluation of partial derivatives is straightforward and will be illustrated 
with dF/dXj. Equation (14.2) can be rewritten as 

r y l /2 

F(x h y t , Xj, yj) = [(xj - x t y + {y } - y,) \ 


(14.5) 
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Taking the derivative of Equation (14.5) with respect to x t yields 


dF 1 


= T [(■*/ - A '/) 2 + O; - yd 2 } X '~ [2 (Xj - *,-)(- D] 


dx, 2 1 1 
Simplifying Equation (14.6) yields 

-(.Xj - x t ) 


(14.6) 


dF 

dx,- 


yJiXj-xf + iyj-y ,) 2 


IJ 


(14.7) 


Employing the same procedure, the remaining partial derivatives are 


dF yt-yj dF Xj 


dy t 


IJ 


dX: 


IJ 


dF = yj-yi 

dyj ~ 


IJ 


(14.8) 


If Equations (14.7) and (14.8) are substituted into Equation (14.3) and the 
results substituted into Equation (14.2), the following prototype linearized dis¬ 
tance observation equation obtained is 


x t ~ Xj 

IJ 


dx ' + ( }j u)f yi + Vu) dXj + \u) dy] = kl + Vl 


(14.9) 

where the coefficients in the parentheses are evaluated at the approx¬ 
imate parameter values, k t = ly — // 0 , and /./„ = F(x in ,y in ,Xj n , y /(j ) = 

\Z (x /o _ x if ) 2 + 0) 0 _ >’f 0 ) 2 - 


14.3 TRILATERATION ADJUSTMENT EXAMPLE 

Even though the geometric figures used in trilateration are many and 
varied, they are equally adaptable to the observation equation method in a 
parametric adjustment. Consider the example shown in Figure 14.2, where 
the distances are observed from three stations with known coordinates to a 
common unknown station U. Since the unknown station has two unknown 
coordinates and there are three observations, this yields one redundant obser¬ 
vation. That is, the coordinates of station U could be determined using any two 
of the three observations. But all three observations can be used simultaneously 
and adjusted by the method of least squares to determine the most probable 
value for the coordinates of the station based on these three observations. 

The observation equations are developed by substituting into prototype 
Equation (14.9). For example, the equation for distance AU is formed by 
interchanging subscript / with A and subscript J with U in Equation (14.9). 
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In a similar fashion, an equation can be created for each observed distance 
using the following subscript substitutions: 


I 

J 

A 

u 

B 

u 

C 

u 


When one end of the observed line is a control station, its coordinates are 
fixed, and thus those terms can be dropped in prototype Equation (14.9). 2 
This can be thought of as setting the dx and dy corrections for the control 
station equal to zero. In this example, station U always takes the position of 
J in the prototype equation, and thus only the coefficients corresponding to 
dxj and dy J are used. Using the appropriate substitutions, the following three 
linearized observation equations result: 

X,, - x„ y„ - y„ 

-ju^ dx » + ~zu^ d y* = ~ AU ° ) + 

x„ - x h y„ - y h 

nTTr dx u + -^—dy u = (l BU — A U 0 ) + v BU 
BUq BU 0 

rTJ dx u 4 —— dy u = (l C u ~ CU 0 ) + v cu (14.10) 

L-Uq l.u 0 

In Equation (14.10), 

a Uq = yj ( x Uo - x a ) 2 4- (>’„ o - y a ) 2 , 

BU 0 = y/(x Uo -x b ) 2 + (y Uo - y b ) 2 , 

CU 0 = ^(x Uo -x c ) 2 + (y Uo -y c ) 2 \ 

2 The method of dropping of control station coordinates from the adjustment is known as elimi¬ 
nation of constraints. This method is covered in Chapter 20. 
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1 AU , l BU , and l cu are the observed distances; the v’s are residuals; and x Uq and y Un 
are initial coordinate values for station U. Equations (14.10) can be expressed 
in matrix form as 

JX = K + V (14.11) 

where J is the Jacobian matrix of partial derivatives, X the matrix or unknown 
corrections dx u and dy u , K the matrix of constants (i.e., the observed lengths, 
minus their corresponding lengths computed from the initial approximate 
coordinates), and V the residual matrix. Equation (14.11) in expanded 
form is 


x u 0 - x a 

y Uo -y a 

AU 0 

AU, 

X u 0 ~ X b 

y H -yb 

BU, 

BU, 

x u —x r 

u 0 c 

y Uo -y c 

CU, 

cu. 


dx 


Iau 

-AU, 


VAU 

d y u _ 


Ibu 

lcu 

-BU, 

-CU, 

+ 

V BU 

V CU 


(14.12) 


The Jacobian matrix can systematically be formed using the following 
steps: 

Step 1: Head each column with an unknown value. 

Step 2: Create a row for every observation. 

Step 3: Substitute in the appropriate coefficient corresponding to the column 
into each row. 


If this procedure is followed for this problem, the Jacobian matrix is 

dx u dy u 
dF dF 
dx u dy u 
dF dF 
dx u dy u 

dF dF 

dx u dy u _ 

Once Equation (14.12) is created, the corrections of dx u and dy u , and 
thus the most probable coordinate values, x u and y u can be computed using 
Equation (11.37). Of course, to obtain the final adjusted values, the solution 
must be iterated, as discussed in Section 11.10 and Appendix C. 


AU | 
BU | 
CU | 


















264 ADJUSTMENT OF HORIZONTAL SURVEYS: TRILATERATION 


Example 14.2 To clarify the computational procedure, a numerical example 
for Figure 14.2 is presented. Suppose that the observed distances l AU , l BU , and 
l cu are 6049.00, 4736.83, and 5446.49 ft, respectively, and the control stations 
have coordinates in units of feet of 

x a = 865.40 x b = 2432.55 x, = 2865.22 

y a = 4527.15 y b = 2047.25 y c = 27.15 

(Note that these are the translated coordinates obtained in Example 14.1.) 
Compute the most probable coordinates for station U. 


SOLUTION Perform the first iteration. 


Step 1: Calculate approximate coordinates for station U. 

(a) Calculate azimuth AB from the coordinate values of stations 
A and B. 


Az ab = tan - 


1 / 


+ 180° 


,yb -y a 

_! / 2432.55 - 865.40 

= tan 


V2047.25 -4527.15 
= 147°42'34" 


+ 180° 


(b) Calculate the distance between Station A and B from their coordinate 
values. 

AB = -\J(x b - x a ) 2 + (y b - y a ) 2 

= yj (2432.55 - 865.20) 2 + (2047.25 - 4527.15) 2 
= 2933.58 ft 


(c) Calculate azimuth AU 0 using the law of cosines in triangle AUB. 
c 2 = a 2 + b 2 - lab cos C 


cos( UAB) = 


6049.00 2 + 2933.58 2 


■ 4736.83- 


2(6049.00)(2933.58) 

UAB = 50°06'50" 

Az au = 147°42'34" - 50°06'50" = 97°35 , 44" 


(d) Calculate the coordinates for station U. 


x u =865.40+ 6049.00 sin 97°35'44" = 6861.325 ft 
y Uo = 4527.15 + 6049.00 cos 97° 35 ; 44" = 3727.596ft 
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Step 2: Calculate AU 0 , BU 0 , and CU 0 . For this first iteration, AU 0 and BU 0 
are exactly equal to their respective observed distances since jc and y Ua 
were calculated using these quantities. Thus, 


A C/q — 6049.00 BUq = 4736.83 

CUq = yj (6861.325 - 2865.22) 2 + (3727.596 - 27.15) 2 = 5446.298 ft 
Step 3: Formulate the matrices. 

(a) The elements of the Jacobian matrix in Equation (14.12) are 3 


6861.325- 865.40 
6049.00 

6861.325- 2432.55 
4736.83 

6861.325- 2865.22 
5446.298 


0.991 

in — 

3727.596-4527.15 

= -0.132 

6049.00 

0.935 

hi = 

3727.596 - 2047.25 

= 0.355 

4736.83 

0.734 


3727.596-27.15 _ 
5446.298 

0.679 


(b) The elements of the K matrix in Equation (14.12) are 


k l = 6049.00 - 6049.00 = 0.000 
k 2 = 4736.83 - 4736.83 = 0.000 
k 3 = 5446.49 - 5446.298 = 0.192 


Step 4: The matrix solution using Equation (11.37) is 


X = (J t J)J t K 


0.991 0.935 
-0.132 0.355 


0.734 

0.679 


0.991 

0.935 

0.735 


-0.132 

0.355 

0.679 


2.395 0.699 
0.699 0.605 




1 

0.960 


0.605 

-0.699 


-0.699 

2.395 





0 . 000 ' 



0.991 

0.935 

0.734 



0.141 

0.000 

-0.132 

0.355 

0.679 



0.130 





0.192 




1 

0.605 

-0.699 


0.141 


-0.006 

0.960 

-0.699 

2.395 


0.130 


0.222 


3 Note that the denominators in the coefficients of Step 3 are distances computed from the approx¬ 
imate coordinates. Only distances computed in the first iteration will match the observed distances 
exactly. Do not use observed distances for the denominators of these coefficients. Failure to heed 
this warning will sometimes result in no solution or an incorrect solution to problem. 
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The revised coordinates of U are 


x u = 6861.325 - 0.006 = 6861.319 
y u = 3727.596 + 0.222 = 3727.818 

Now perform the second iteration. 

Step 1: Calculate AUq, BU 0 , and CU 0 . 

AU 0 = yj (6861.319 - 865.40) 2 + (3727.818 - 4527.15) 2 = 6048.965ft 

BU 0 = yj (6861.319 - 2432.55) 2 + (3727.818 - 2047.25) 2 = 4736.909ft 

CU 0 = yj (6861.319 - 2865.22) 2 + (3727.818 - 27.15) 2 = 5446.444ft 

Notice that these computed distances no longer match their observed 
counterparts. 

Step 2: Formulate the matrices. With these minor changes in the lengths, 
the J matrix (to three places) does not change, and thus (J r J)~ l does 
not change, either. Flowever, the K matrix does change, as shown by the 
following computations. 

k l = 6049.00 - 6048.965 = 0.035 
k 2 = 4736.83 - 4736.909 = -0.079 
k] = 5446.49 - 5446.444 = 0.046 

Step 3: Matrix solution 


0.991 0.935 0.734' 
-0.132 0.355 0.679 


0.035 

-0.079 

0.046 

= 

-0.005' 

-0.001 

1 

0.605 -0.699' 


-0.005" 


-0.002 

0.960 

-0.699 2.395 


-0.001 


0.001 


The revised coordinates of U are 

x u = 6861.319 - 0.002 = 6861.317 
y u = 3727.818 + 0.001 = 3727.819 

Satisfactory convergence is shown by the very small corrections in the sec¬ 
ond iteration. This problem has also been solved using the program ADJUST, 
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which is available on the companion website for this book and the text hie 
shown in Figure 14.3. Values computed include the most probable coordinates 
for station U, their standard deviations, the adjusted lengths of the observed 
distances, their residuals and standard deviations, and the reference variance 
and standard deviation. These are tabulated as shown below. 



FIGURE 14.3 File format for Example in ADJUST. 


Adjusted stations 

Station X Y Sx Sy 


U 6,861.32 3,727.82 0.078 0.154 


Adjusted Distance Observations 

it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it 

Station Station 

Occupied Sighted Distance V S 


A 

B 

C 


U 6,048.96 
U 4,736.91 
U 5,446.44 


-0.037 0.090 
0.077 0.060 
-0.047 0.085 


Adjustment Statistics 
Sq = 0.00954 
S 0 =±0.10 
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14.4 FORMULATION OF A GENERALIZED COEFFICIENT MATRIX 
FOR A MORE COMPLEX NETWORK 

In the trilaterated network of Figure 14.4, all lines were observed. 
Assume that stations A and C are control stations. For this network, there 
are 10 observations and eight unknowns. Stations A and C can be fixed by 
setting the terms dx a , dy a , dx c , and dy c to zero, which effectively drops these 
terms from the solution. The coefficient matrix formulated from prototype 
Equation (14.9) has nonzero elements, as indicated in Table 14.1. In this 
table, the appropriate coefficient from Equation (14.9) is indicated by its 
corresponding unknown terms of dx h dy r dxj, or dy 



TABLE 14.1 Structure of the Normal Matrix for Complex Network in Figure 14.3 


Distance 

IJ 




Unknown 




dx b 

dy b 

dx d 

dy d 

dx e 

dy e 

dxr 

dy f 

AB 

dxj 

dyj 

0 

0 

0 

0 

0 

0 

AE 

0 

0 

0 

0 

dx- 

dvj 

0 

0 

BC 

dx t 

dVi 

0 

0 

0 

0 

0 

0 

BF 

dx t 

d}'i 

0 

0 

0 

0 

dxj 

dyj 

BE 

dx t 

dy, 

0 

0 

dXj 

dVj 

0 

0 

CD 

0 

0 

dxj 

dyj 

0 

0 

0 

0 

CF 

0 

0 

0 

0 

0 

0 

dxj 

dyj 

DF 

0 

0 

dxj 

dy’i 

0 

0 

dxj 

dyj 

DE 

0 

0 

dx t 

dy, 

dxj 

dvj 

0 

0 

EF 

0 

0 

0 

0 

dx t 

dVi 

dXj 

dyj 
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14.5 COMPUTER SOLUTION OF A TRILATERATED QUADRILATERAL 

The quadrilateral shown in Figure 14.5 was adjusted using the MATRIX soft¬ 
ware. In this problem, points Bucky and Badger are control stations whose 
coordinates are held fixed. The five observed distances are 


Line 

Distance (ft) 

Badger - Wisconsin 

5870.302 

Badger - Campus 

7297.588 

Wisconsin - Campus 

3616.434 

Wisconsin - Bucky 

5742.878 

Campus - Bucky 

5123.760 


The state plane control coordinates in units of feet for station Badger are 
x = 2,410,000.000 and y = 390,000.000, and for Bucky are x = 2,411,820.000 
and y = 386,881.222. 

Step 1: To solve this problem, approximate coordinates are first computed 
for stations Wisconsin and Campus. This is done following the procedures 
used in Section 14.3, with the resulting initial approximations being 

Wisconsin: x = 2,415,776.819 y = 391,043.461 
Campus: x = 2,416,898.227 y = 387,602.294 

Step 2: Following prototype Equation (14.9) and the procedures outlined in 
Section 14.4, a table of coefficients is established. For the sake of brevity 
in Table 14.2, the following station assignments were made: Badger = 1, 
Bucky = 2, Wisconsin = 3, and Campus = 4. 


Legend: ▲ Control station 



FIGURE 14.5 Quadrilateral network. 
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TABLE 14.2 Structure of the Coefficient or J Matrix for Example in Figure 14.4 



dx 

Wisconsin 

^Wisconsin 

^ x Campus 

Campus 

Badger - Wisconsin 1-3 

Badger - Campus 1-4 

*3 0 -*l 

3\-fi 

1 O 

>< 

o l 

■sp 

(l-3)o 

0 

(l-3)o 

0 

d-4)o 

d-4)o 

Wisconsin - Campus 3-4 

Xo - Xa 
^0 4 0 

/3„-V 4o 

X 4 0 - X 3 0 

/4 0 -V 3o 

(3-4) 0 

(3-4) 0 

(3-4) 0 

(3-4) 0 

Wisconsin - Bucky 3-2 

Campus - Bucky 4-2 

Xo - x 9 

- 5 o z o 

/3 0 -k2 0 

0 

X 4 0 - *2 0 

0 

/4 0 -l2 0 

(3-2) 0 

0 

(3-2) 0 

0 

(4-2) 0 

(4-2) 0 


After forming the /matrix, the K matrix is computed. This is done in a man¬ 
ner similar to step 3 of the first iteration in Example 14.2. The matrices were 
entered into a hie following the format described in Section 12.7. Section 14.7 
discusses in more detail the procedures used to solve these problems with the 
software on the companion website for this book. Following are the input data, 
matrices for the first and last iterations of this three-iteration solution, and the 
tabulated final results. 


* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * 

Initial approximations for unknown stations 

* * * * * * * * * * * * * * * * * k k k k k k k k k k k k k k k k k k k k k k k k k k 


Station 

X 

Y 


Wisconsin 

2,415,776.819 

391,043 

.461 

Campus 

2,416,898.227 

387,602 

.294 

Control Stations 



Station 

X 

Y 


Badger 

2,410,000.000 

390,000. 

000 

Bucky 2,411,820.000 

386,881. 

222 


Distance Observations 

J. J. J. A JU JU .I. JU JU J. J. J. JU .1. JU JL 

Occupied Sighted Distance 


Badger Wisconsin 
Badger Campus 

Wisconsin Campus 

Wisconsin Bucky 

Campus Bucky 


5,870.302 

7,297.588 

3,616.434 

5,742.878 

5,123.760 
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First Iteration Matrices 


J Dim: 5x4 



l< Dim: 5x1 X 

Dim 4x1 

0.98408 

0.00000 

-0.B0984 

0.68900 

0.00000 

0.17775 0. 

0.00000 0 . 

0.95079 0. 

0.72477 0. 

0.00000 0 . 

00000 0.00000 

94457 -0.32832 

30984 -0.95079 

00000 0.00000 

99007 0.14058 

-0.00026 

-5.46135 

-2.84579 

-0.00021 

0.084751 

-0.165221 

-5.531445 

0.959315 



JtJ Dim: 4x4 




1.539122 

0.379687 

-0.096003 

0.294595 

0.379687 

1.460878 

0.294595 

-0.903997 

-0.096003 

0.294595 

1.968448 

-0.465525 

0.294595 

-0.903997 

-0.465525 

1.031552 


Inv( N ) Dim 

: 4x4 




1.198436 

-1.160169 

-0.099979 

-1.404084 

-1.160169 

2.635174 

0.194272 

2.728324 

-0.099979 

0.194272 

0.583337 

0.462054 

-1.404084 

2.728324 

0.462054 

3.969873 


Final Iteration 

3 Dim: 5x4 



K Dim:5x1 : 

X Dim 4x1 

0.98408 

0.00000 

-0.30853 

0.68902 

0.00000 

0.17772 0. 

0.00000 0 . 

0.95121 0. 

0.72474 0. 

0.00000 0 . 

00000 0.00000 

94453 -0.32843 

30853 -0.95121 

00000 0.00000 

99002 0.14092 

-0.05468 

0.07901 

-0.03675 

0.06164 

-0.06393 

0.000627 

-0.001286 

-0.000040 

0.001814 

3t3 Dim: 4x4 





1.538352 

0.380777 

-0.095191 

0.293479 


0.380777 

1.461648 

0.293479 

-0.904809 


-0.095191 

0.293479 

1.967465 

-0.464182 


0.293479 

-0.904809 

-0.464182 

1.032535 


Qxx = Inv( N 

) Di m: 4x4 




1.198574 

-1.160249 

-0.099772 

-1.402250 


-1.160249 

2.634937 

0.193956 

2.725964 


-0.099772 

0.193956 

0.583150 

0.460480 


-1.402250 

2.725964 

0.460480 

3.962823 
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Qll = I Qxx It Dim: 5x5 


0.838103 0.233921 

-0.108806 

0.182506 

-0.189263 

0.233921 0.662015 

0.157210 

-0.263698 

0.273460 

0.108806 0.157210 

0.926875 

0.122656 

-0.127197 

0.182506 -0.263698 

0.122656 

0.794261 

0.213356 

0.189263 0.273460 

-0.127197 

0.213356 

0.778746 

* * * * * * * * * * * * * * * * * 




Adjusted stations 

J. J. J. .1. J. J, .1. «*. .I. .I. .I. «*. .I. A 




Station X 

Y 

Sx 

Sy 

Wisconsin 2,415,776.904 

391,043.294 

0.1488 0.2206 

Campus 2,416,892.696 

387,603.255 

0.1038 0.2705 

A A A A A A A A A A A A A A A A A A A A A A A A A A A A A A 

Adjusted Distance Observations 



* * * * * * * * * * * * * * * * * * *V * * * * * 

: * * Vc * V* 



Occupied Sighted 

Distance 

V 

S 

Badger Wisconsin 

5,870.357 

0.055 

0.1244 

Badger Campus 

7,297.509 

-0.079 

0.1106 

Wisconsin Campus 

3,616.471 

0.037 

0.1308 

Wisconsin Bucky 

5,742.816 

-0.062 

0.1211 

Campus Bucky 

5,123.824 

0.064 

0.1199 


-Reference Standard Deviation = ±0.155905 

Iterations » 5 


Notes 

1. As earlier noted, it is important that observed distances not be used in the 
denominator of the coefficients matrix, J. This is not only theoretically 
incorrect, but it can cause slight differences in the final solution or even 
worse, cause the system to diverge from any solution! Always compute 
distances based on the current approximate coordinates. 

2. The final portion of the output lists the adjusted x and y coordinates of 
the stations, the reference standard deviation, the standard deviations of 
the adjusted coordinates, the adjusted line lengths, and their residuals. 

3. The Q xx matrix was listed on the last iteration only. It is needed for cal¬ 
culating the estimated errors of the adjusted coordinates using Equation 
(14.24), and is also necessary for calculating error ellipses. The subject of 
error ellipses is discussed in Chapter 19. 
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14.6 ITERATION TERMINATION 

When programming a nonlinear least squares adjustment, some criteria must 
be established to determine the appropriate point at which to stop the iteration 
process. Since it is possible to have a set of data that has no solution, it is also 
important to determine when this condition occurs. This section describes three 
methods used to indicate the appropriate time to end the iteration process. 

14.6.1 Method of Maximum Iterations 

The simplest procedure of iteration termination involves limiting the number 
of iterations to a predetermined maximum. The risk with this method is that 
if this maximum is too low, a solution may not be reached at the conclusion 
of the process, and if it is too high, time is wasted on unnecessary iterations. 
Although this method does not assure convergence, it can prevent the adjust¬ 
ment from continuing indefinitely, which could occur if the solution diverges. 
When good initial approximations are supplied for the unknown parameters, 
a limit of 10 iterations should be well beyond what is required for a solution 
since the method of least squares converges quadratically. 

14.6.2 Maximum Correction 

This method was used in earlier examples. It involves monitoring the absolute 
size of the corrections. When all corrections become negligibly small, the 
iteration process can be stopped. The term negligible is relative. For example, 
if distances are observed to the nearest foot, it would be foolish to assume that 
the size of the corrections will become less than some small fraction of a foot. 
Generally, negligible is interpreted as a correction that is less than one-half 
the least count of the smallest unit of measure. For instance, if all distances are 
observed to the nearest 0.01 ft, it would be appropriate to assume convergence 
when the absolute size of all corrections is less than 0.005 ft. While the solution 
may continue to converge with continued iterations, the work to get these 
corrections is not warranted based on the precision of the observations. 

14.6.3 Monitoring the Adjustment’s Reference Variance 

The best method for determining convergence involves monitoring the refer¬ 
ence variance and its changes between iterations. Since the method of least 
squares converges quadratically, the iteration process should be stopped if 
the reference variance increases. An increasing reference variance suggests a 
diverging solution, which happens when one of two things has occurred: (1) 
a large blunder exists in the data set and no solution is possible or (2) the 
maximum correction-size is less than the precision of the observations. In the 
second case, the best solution for the given data set has already been reached, 
and when another iteration is attempted, the solution will converge only to 
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diverge on the next iteration. This apparent bouncing in the solution is caused 
by convergence limits being too stringent for the quality of the data. 

By monitoring the reference variance, convergence and divergence can be 
detected. Convergence is assumed when the change in the reference variance 
falls below some predefined percentage. Convergence can be assumed when 
the change in the reference variance is less than 1% between iterations. If the 
size of the reference variance increases, the solution is diverging and the 
iteration process should be stopped. It should also be noted that monitoring 
changes in the reference variance will always show convergence or divergence 
in the solution, and thus, it is better than any method discussed previously. 
However, all methods should be used in concert when doing an adjustment. 


14.7 SOFTWARE 

The hand or calculator computation of the equations presented in this chapter 
can be tedious and often filled with mistakes. This explains why the method of 
least squares was not implemented fully until the advent of the computer. 

Figure 14.6 shows the spreadsheet used to solve Example 14.2. By naming 
cells, the matrices can be easily developed for use in the MATRIX software. 


Control Station Coordinates 

X A 865.40 X B 2432.55 

Y a 4527.15 Y b 2047.25 

Unknown Station 1 2 

X y 6861.325 -0.008209 -3.53E-06 

Y y 3727.596 0.2225678 -2.03E-06 


X c 2865.22 
Y c 27.15 

3 Final 

6861.3168 

3727.8186 


Distances 

Observed 

Computed 

AU 

6049.00 

6048.963 

BU 

4736.83 

4736.9068 

CU 

5446.49 

5446.4426 

File to cut and paste Into 

MATRIX 

Example 14.2 

J 


3 

2 


0.9912306 

-0.132144 


0.9349491 

0.3547819 


0.7337077 

K 

0.6794653 


3 

0.037 

-0.077 

0.047 

1 



FIGURE 14.6 Example of a spreadsheet that develops matrices for Example 14.2 
for use in MATRIX. 
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which is available on the companion website for this book. The spreadsheet 
allows updates to the approximate coordinates for station U. Since the com¬ 
puted values in the computed distances and the J and K matrices are linked 
to the changes in the final coordinates for U, these matrices are automatically 
updated as the corrections are entered. The matrices shown in the figure are 
then cut and pasted into a new file in MATRIX, as shown in Figure 14.7. 
The MATRIX software computes the least squares solution to the problem, 
and the resultant corrections are copied and pasted back into the spreadsheet. 
This process is repeated until the corrections are negligibly small. The file for¬ 
mat for MATRIX was discussed in Section 12.7. The file chapter 14.xls 
contains the spreadsheet for the examples 14.2 and that presented 
in Section 14.5. 

Figure 14.3 shows the file for Example 14.2 in the ADJUST software, which 
is available on the companion website for this book. In this figure, the explana¬ 
tory information is shown to the right of the file and is indicated by the curly 
brackets {•}. This information should not be entered into the file. A zero is 
entered into the second line of the file to indicate that this problem did not have 
any angles or azimuths. The software uses free format reading rules. A comma, 
space, or tab character can be used to delimit the individual entries. This means 
that a space cannot be placed in a station identifier. A hyphen or underscore 
can be used in the place of a space where necessary. Thus, station identifiers like 
“My Sta” will be interpreted as the two identifiers “My” and “Sta.” The station 



FIGURE 14.7 File format for Example 14.2 in MATRIX. 
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identifier should be entered as “My_Sta” or “MySta” to avoid reading errors. 
Notice that station identifiers in the distance observations are separated by a 
space. The first observed distance is entered as “A U 6049.00.” Since Example 
14.2 is unweighted, the distances do not have standard deviation entries. If this 
was a weighted example, the standard deviation for each observation would 
follow the distance observation in each line. 

Likewise, a Mathcad electronic book is available on the companion 
website for this book, which demonstrates a programmatic solution to both 
Examples 14.2 and 14.5. This software, while very brute force in this example, 
demonstrates common techniques that are used by commercial software and 
ADJUST to perform the least squares solutions. 


PROBLEMS 

Note: For problems below requiring least squares adjustment, if a computer 
program is not distinctly specified for use in the problem, it is expected that the 
least squares algorithm will be solved using the program MATRIX, which is 
included on the book’s companion website. Partial answers to problems marked 
with an asterisk can be found in Appendix H. 

* 14.1 The following observed values for the lines in Figure 14.2 are given: 

AU = 2828.83ft BU = 2031.55ft CU = 2549.83 ft 
The control coordinates of A, 7?, and C are 


Station 

x (ft) 

y (ft) 

A 

1418.17 

4747.14 

B 

2434.53 

3504.91 

C 

3234.86 

2105.56 


What are the most probable values for the adjusted coordinates of 
station U1 

14.2 Do a weighted least squares adjustment using the data in Problem 14.1 
with weights based on the following observational errors. 

AU = ±0.051 ft BU = ±0.045 ft CU = ±0.035 ft 

(a) Tabulate the most probable values for the adjusted coordinates of 
station U and their standard deviations. 
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*(b) What is the reference standard deviation of unit weight? 

(c) Tabulate the adjusted distances, their residuals and standard 
deviations. 

14.3 Do a least squares adjustment for the following observed values for the 
lines in the accompanying figure. 



AC= 1500.00 ft AD = 1449.98 ft BC = 1322.87 ft 
BD = 2133.62 ft CD = 1475.66 ft 

In the adjustment, hold the coordinates of Stations A and B (in units 
of feet) of 


x a = 10,000.00 ft and y a = 10,000.00 ft 
x h = 10,258.82ft and = 10,965.92 ft 

Use the initial approximations for C and D of 

x t , = n, 448.89, y c = 10,388.23, and x d = 11,025.30, y d = 8,974.70 

*(a) Tabulate the most probable values and standard deviations for the 
adjusted coordinates of stations C and D. 
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(b) What is the reference standard deviation of unit weight? 

(c) Tabulate the adjusted distances, their residuals, and the standard 
deviations. 

14.4 Repeat Problem 14.3 using a weighted least squares adjustment, where 
the distance standard deviations are 

AC = ± 0.016ft AD — ±0.016ft 5C = ±0.016ft 
BD = ±0.018 ft CD = ±0.016 ft 

14.5 Use the ADJUST software to do Problems 14.3 and 14.4. Explain any 
differences in the adjustments. 

14.6 Using the trilaterated Figure 14.4 and the data below: 

(a) Tabulate the most probable station coordinates and their standard 
deviations. 

(b) Reference standard deviation of unit weight. 

(c) Tabulate the adjusted distances, their residuals, and standard 
deviations. 


Initial Approximations 


Control Stations 


Station Easting (ft) 

Northing (ft) 

Station 

Easting (ft) 

Northing (ft) 

B 10,862.50 

11,103.94 

A 

10,000.00 

10,000.00 

D 11,990.88 

9,387.46 

C 

12,487.08 

10,528.65 

E 10,948.55 

9,461.91 




F 11,595.232 

10,131.57 





Distance Observations 


Station Occupied 

Station Sighted 

Distance (ft) 

5 (ft) 

A 

B 

1400.92 

0.021 

B 

C 

1723.43 

0.021 

C 

D 

1244.40 

0.020 

D 

E 

1044.95 

0.020 

E 

A 

1090.57 

0.020 

B 

E 

1644.28 

0.021 

B 

F 

1217.51 

0.020 

F 

E 

930.93 

0.020 

F 

C 

976.27 

0.020 

F 

D 

842.77 

0.020 
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14.7 Using the station coordinates and trilateration data given below: 

*(a) Tabulate the most probable coordinates for station E and their 
standard deviations. 

(b) Reference standard deviation of unit weight. 

(c) Tabulate the adjusted distances, their residuals, and standard 
deviations. 


Control Stations Initial Approximations 

Station Easting (m) Northing (m) Station Easting (m) Northing (m) 


A 5643.154 8213.066 

B 6093.916 7422.484 

C 7515.536 7061.874 

D 9451.837 7544.403 


Distance Observations 

From 

To 

Distance (m) 

S (m) 

A 

E 

2576.364 

0.009 

B 

E 

2857.787 

0.010 

C 

E 

2751.659 

0.010 

D 

E 

2884.774 

0.010 


E 


7665.34 


9809.45 


14.8 Repeat Problem 14.7 using the following data. 


Control Stations Initial Approximations 


Station Easting (ft) 

Northing (ft) 

Station Easting (ft) 

Northing (ft) 

A 2643.15 

3213.07 

E 2708.54 

5886.94 


B 

3243.91 

4403.57 


C 

4489.53 

2984.65 


D 

4985.06 

4007.89 


Distance Observations 



From 

To 

Distance (ft) 

s (ft) 

A 

E 

2674.66 

0.022 

B 

E 

1577.01 

0.016 

C 

E 

3405.18 

0.024 

D 

E 

2951.80 

0.023 
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14.9 Using the station coordinates and trilateration data given below, find: 

(a) Most probable coordinates for the unknown stations and their 
standard deviations. 

(b) Reference standard deviation of unit weight. 

(c) The adjusted distances, their residuals, and standard deviations. 


Station 

U(ft) 

Y (ft) 

Station 

*(ft) 

Y (ft) 

A 

983.98 

566.74 

B 

971.83 

1314.92 

D 

911.85 

1808.16 

E 

1243.00 

888.99 




F 

1210.95 

1608.31 




H 

1545.68 

637.08 




I 

1506.48 

1177.69 




J 

1499.65 

1871.07 


Distance Observations 


From 

To 

Distance (ft) 

5 (ft) 

A 

B 

748.27 

0.012 

A 

E 

413.44 

0.012 

B 

E 

504.93 

0.012 

B 

F 

378.49 

0.012 

B 

D 

496.85 

0.012 

D 

F 

359.74 

0.012 

D 

J 

591.15 

0.012 

J 

F 

390.35 

0.012 

I 

J 

693.41 

0.012 

I 

F 

522.29 

0.012 

I 

E 

390.86 

0.012 

H 

I 

542.04 

0.012 

E 

H 

393.78 

0.012 

E 

F 

720.03 

0.012 


14.10 Using the station coordinates and trilateration data given below, find: 

(a) Most probable coordinates for the unknown stations and their 
standard deviations. 

(b) Reference standard deviation of unit weight. 

(c) The adjusted distances, their residuals, and standard deviations. 
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Control Station 


Station 

x (ft) 

Y (ft) 

A 

3,822.88 

5,033.21 

C 

15,527.68 

7,586.72 


Initial Approximations 


Station 

x (ft) 

Y (ft) 

B 

11,601.48 

5,077.49 

D 

11,808.12 

10,774.91 

E 

3,837.64 

11,143.91 


Distance Observations 


From 

To 

Distance (ft) 

sm 

A 

B 

7778.73 

0.044 

B 

C 

4659.52 

0.031 

C 

D 

4898.96 

0.032 

D 

E 

7979.02 

0.045 

A 

D 

9835.30 

0.053 

B 

E 

9852.81 

0.053 

B 

D 

5701.17 

0.035 

E 

A 

6110.75 

0.036 


14.11 Perform a % 2 test to check if the reference variance from Problem 14.4 
is statistically equal to its a priori value of one. 


14.12 

Repeat Problem 
Problem 14.9. 

14.11, 

checking 

the 

reference 

variance for 

14.13 

Repeat Problem 

14.11, 

checking 

the 

reference 

variance for 


Problem 14.10. 

14.14 Use the ADJUST software to do Problem 14.4. 

14.15 Use the ADJUST software to do Problem 14.9. 

14.16 The reference variance for the first iteration of a weighted least squares 
adjustment is 1.586. On the second iteration, it is 1.573. Has the adjust¬ 
ment converged? Justify your response. 

14.17 What is the standard deviation of unit weight for the adjustment in 
Problem 14.16? 

14.18 Describe in detail the methods used to detect convergence in a non¬ 
linear least-squares adjustment and the advantages and disadvantages 
of each. 
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PROGRAMMING PROBLEMS 

14.19 Create a computational program that computes the distance, coeffi¬ 
cients, and k/ in Equation (14.9) between stations I and J, given their 
initial coordinate values. Use this spreadsheet to determine the matrix 
values necessary for solving Problem 14.9. 

14.20 Create a computational program that reads a data hie containing 
station coordinates and distances and generates the /, W, and K 
matrices that can be used by the MATRIX program. Demonstrate 
that this program works by using the data of Problem 14.9. 

14.21 Create a computational program that reads a hie containing the /, W, 
and K matrices and finds the most probable value for the station coor¬ 
dinates, the reference standard deviation, and the standard deviations 
of the station coordinates. Demonstrate that this program works by 
solving Problem 14.9. 

14.22 Create a computational program that reads a hie containing control 
station coordinates, initial approximations of unknown stations, and 
distance observations. The program should generate the appropriate 
matrices for a least squares adjustment, do the adjustment, and print 
out the final adjusted coordinates, their standard deviations, the 
hnal adjusted distances, their residuals, and the standard deviations 
in the adjusted distances. Demonstrate that this program works by 
solving Problem 14.9. 


CHAPTER 15 


ADJUSTMENT OF HORIZONTAL 
SURVEYS: TRIANGULATION 


15.1 INTRODUCTION 

Prior to the development of electronic distance measuring equipment and the 
global navigation satellite systems, triangulation was the preferred method 
for extending horizontal control over long distances. The positions of widely 
spaced stations were computed from observed angles and a minimal number 
of observed distances called baselines. This method was used extensively by 
the National Geodetic Survey in extending much of the national network. 
Triangulation is still used by many surveyors in establishing horizontal 
control, although surveys that combine trilateration (distance observations) 
with triangulation (angle observations) are more common. In this chapter, 
methods are described for adjusting triangulation networks using least squares 
method. 

A least squares triangulation adjustment can use condition equations or 
observation equations written either in terms of azimuths or angles. In this 
chapter the observation equation method is presented. The procedure involves 
a parametric adjustment where the parameters are coordinates in a plane rect¬ 
angular system such as state plane coordinates. In the examples, the specific 
types of triangulations known as intersections, resections, and quadrilaterals 
will be adjusted. 
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15.2 AZIMUTH OBSERVATION EQUATION 

The azimuth equation in parametric form is 

azimuth = a + C (15.1) 

where a = tan -1 x t and j, are the coordinates of the occupied station 

/; x. and y - are the coordinates of the sighted station /; and C is a constant 
that depends on the quadrant in which point J lies as shown in Figure 15.1. 
From Figure 15.1, Table 15.1 can be constructed that relates the algebraic sign 
of the computed angle a in Equation (15.1) to the value of C and the value of 
the azimuth. 


15.2.1 Linearization of the Azimuth Observation Equation 


Referring to Equation (15.1), the observation equation for an observed azimuth 
of line IJ is 


tan 1 


Xj ~ Xj 

yj-Vi 


+ C - Azy + v Az 


(15.2) 


where A z (/ is the observed azimuth from station / to station J, v A . the residual 
in the observed azimuth, x i and y t the most probable values for the coordinates 
of station /, x., and >> / the most probable values for the coordinates of station 


y-y 

J i 

k J 

-^ J 

y' 1 

f ! / 

L 

X X 

I i 

x.-x. 

1 ' 

n 

Ik 

y.-y, 

i 

x-x 

' ' y r y, 


A. 

x. — x. 

y-y. 1 ' 

/ 


I: C = 0° II: C = 180° III: C = 180" IV: C = 360° 

FIGURE 15.1 Relationship between the azimuth and the computed angle, a. 


TABLE 15.1 Relationship between the Quadrant, C, and Azimuth 


Quadrant 

Sign (Xj - x,) 

Sign (yj - y i ) 

Sign a 

C 

Azimuth 

I 

+ 

+ 

+ 

0 

a 

II 

+ 

- 

- 

o 

o 

oo 

a + 180° 

III 

- 

- 

+ 

o 

O 

OO 

a + 180° 

IV 

- 

+ 

- 

360° 

a + 360° 
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J, and C a constant with a value based on Table 15.1. Equation (15.2) is a non¬ 
linear function involving variables x h y h Xs, and y p which can be rewritten as 

F (x^yi, x jt yj) = Az tj + v A . (15.3) 


where 


F (xi,yi,Xj,yj) = tan 



+ C. 


As discussed in Section 11.10, nonlinear equations such as (15.3) can 
be linearized and solved using a first-order Taylor series approximation. 
The linearized form of Equation (15.3) is 


F (x^y^xpyj) = F(x i ,y t ,x j ,y j ) 0 + 



dxj + 
o 



dy t 

o 


+ 



dxj + 
o 



dyj 

o 


(15.4) 


where (dF/dx t ) 0 , (dF/dy t ) 0 , (dF/dxj) 0 , and (dF/dyj) Q are the partial deriva¬ 
tives of F with respect to x t , y t , x, and y, that are evaluated at the initial 
approximations and dx h dy h dxj, and dy. the corrections applied to the initial 
approximations after each iteration such that 


x t = x io + dx t ,y t = y io + dy t , Xj = x ja + dx p and y } = y jo + dyj (15.5) 

To determine the partial derivatives of Equation (15.4) requires the proto¬ 
type equation for the derivative of tan -1 (u) with respect to x, which is 


-^-tan 1 (w) = 
dx 


1 du 
1 + u 2 dx 


(15.6) 


Using Equation (15.6), the procedure for determining the dF/dx t is demon¬ 
strated as follows. 


dF = _1_-1_ 

-i fc-v) 

(-V. - )' + (.vv-.v ,) 1 

_ y> - yj 

u 2 


(15.7) 


By employing similar procedures, the remaining partial derivatives are 
( )F _ x j ~ x i <)F _ yj ~ U <)F _ x i ~ x j 

dyt - IJ 2 ’ dxj ~ IJ 2 ’ dyj ~ if- 


where IJ 2 = {xj- x,) + (yj - y,)". 


(15.8) 
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If Equations (15.7) and (15.8) are substituted into Equation (15.4) and the 
results then substituted into Equation (15.3), the following prototype azimuth 
equation is obtained. 


( 


Vi-yf 



| dXj + 

o 

+ v Az 
Az a 


Xj — X( 

~1F~ 


dy t + 


yj - yi 
if- 


dxj + 

o 



dyj 

o 


(15.9) 


Both 

k Az= Az ii 


tan 


Xj — Xj 

yj-yi' o 


+ c 


and LI 2 = (xj - Xj) + (y } - y t ) 


are evaluated using the approximate coordinate values of the unknown 
parameters. 


15.3 ANGLE OBSERVATION EQUATION 

Figure 15.2 illustrates the geometry for an angle observation. In Figure 15.2, 
B is the backsight station, / the instrument station, and Fthe foresight station. 
As shown in the figure, an angle observation equation can be written as the 
difference between two azimuth observations, and thus for clockwise angles: 

aBIF = Az IF - Az ib = tan -1 ( —- - ] - tan -1 ( —- - J + D = 0 bif + v g 

\yf-yj \yb~yiJ 

(15.10) 

where Q bi i is the observed clockwise angle, v 6 the residual in the observed 
angle, x b and y b the most probable values for the coordinates of the backsight 
station 5, x t and v, the most probable values for the coordinates of the 
instrument station /, ,\y and y< the most probable values for the coordinates 
of the foresighted station F, and D a constant that depends on the quadrants 

y 



FIGURE 15.2 Relationship between an angle and two azimuths. 
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in which the backsight and foresight occur. This term can be computed as 
the difference between the C terms from Equation (15.1) as applied to the 
backsight and foresight azimuths; that is, 

D = C f - C lh 

Equation (15.10) is a nonlinear function of x b , y b , x h y t , Xr, and jy that can 
be rewritten as 

F (x b , y b , x t ,y it x f ,y f ) = 9 hif + v g (15.11) 


where 


.1 l x f~ x i 


tan 


F{xb,y b ,x i ,y i ,Xf,y f )=Xw: 

J Wf-yiJ Wb-yt. 

Equation (15.11) expressed as a linearized, first-order Taylor series 
expansion is 

F(x b ,y b ,Xi,y i ,Xf,yf) = F(x b ,y b ,x i ,y i ,x f ,y f ) 0 + dx b 


dF\ 


+ 


d y b ) o 
<YF_ 

dx f/ o 


dF 


+ ) d y b + [x~ ) dx i + d y , 


dx 


i / 0 


dF 


d yiJo 


dx f + ( ^— J dyf 


(15.12) 


where dF/dx b , dF/dy b , dF/dx h dF/dy h dF/dXf, and dF/dy t are the partial deriva¬ 
tives of F with respect to x b , y b , x h y ; , Xr, and >y, respectively. 

Evaluating partial derivatives of the function F and substituting into 
Equation (15.12), then substituting into Equation (15.11), results in the 
following equation. 


Ti - y b 


dx h + 


IB 2 Jo" b 


x h ~ x i 


IIf Jo 


dy b + 


y b -yi yy-yi 


+ 


where 


x i ~ x b X i ~ X f 


IB - 


IF 


dy t + 


IB 2 

y/ - Ji 


IF 1 


dx , 


IF- Jo 1 


dxf + 


*.• ~ x f 

IF 2 


dy/ 


kg ~ 0 b if ~ d b if 0 


0 b if o = tan’ 


tan-if^] +/) 


1 1 x f~ x i 

yf-ytJo \y b -yiJo 

2 / \ 2 


ib2 = ( x b~ x i) + (y b -yt) 

!F 2 = ( Xf - Xj ) 2 + (y f - yi ) 


k e + v e 
(15.13) 


are evaluated at the approximate values for the unknown coordinates. 
Formulating the linearized angle observation equation can be thought of as 
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the difference in two linearized azimuth equations. Using Equation (15.9) as a 
guide, the difference between the foresight and backsight azimuth is 


( y.-yy 

V IF 2 


dxj + 
o 


x f ~ x i 

IF 2 


dy t + 
o 


( yj-yi 
V IF 2 


dxf + 
o 


Xi - x f 

IF 2 


dy f 

o 


yt - yb 

IB 2 


dxj + 


x b ~ x i 

IB 2 


dy t + 


yb - yt 

IB 2 


dxu + 


x i ~ x b 

IB 2 


dy b 


- k bif + v e 


(«) 


Rearranging and regrouping Equation (a) yields Equation (15.13). This is 
left as an exercise for the reader. 

In formulating the angle observation equation, remember that / is always 
assigned to the instrument station, B the backsight, and F the foresight sta¬ 
tion. This station designation must be strictly followed in employing prototype 
Equation (15.13) as will be demonstrated in the numerical examples that follow, 
and reproduced in the spreadsheet file Chapter 15.xls. As each is discussed, the 
reader may wish to refer to this hie to see how the problem is implemented in 
a spreadsheet. Additionally, the hie C15.xmcd demonstrates these examples in 
the higher-level programming language of Mathcad. These hies can be found 
on the companion website for this book. 


15.4 ADJUSTMENT OF INTERSECTIONS 

When an unknown station is visible from two or more existing control 
stations, the angle intersection method is one of the simplest and sometimes 
most practical ways for determining the horizontal position of a station. 
For a unique computation, the method requires the observation of at least 
two horizontal angles from two control points. For example, angles 6 X and 0 2 
observed from control stations R and S in Figure 15.3 will enable a unique 
computation for the position of station U. If additional control is available. 


y 



FIGURE 15.3 Intersection example. 
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the computations for the unknown station’s position can be strengthened 
by observing redundant angles such as angles 0 3 and 0 4 in Figure 15.3 
and applying the method of least squares. In that case, for each of the four 
independent angles, a linearized observation equation is written in terms of 
the two unknown coordinates x u and y u . 

Example 15.1 Using the method of least squares, compute the most prob¬ 
able coordinates of station U in Figure 15.3. The following equally weighted 
horizontal angles were observed from control stations R , S, and T: 

0, = 50°06'50" 9 2 = 101°30'47" 0 3 = 98°41'17" 0 4 = 59°17'01" 

The coordinates for the control stations R , S, and T are: 

x r = 865.40 x, = 2432.55 x, = 2865.22 
y r = 4527.15 y, = 2047.25 y, = 27.15 


SOLUTION 

Step 1: Determine initial approximations for the coordinates of station U. 

(a) Using the coordinates of stations R and S, the distance RS is com¬ 
puted as 


RS= \J (2432.55 - 865.40) 2 + (4527.15 - 2047.25) 2 
= 2933.58 ft 

(b) From the coordinates of stations R and S , the azimuth of the line 
between R and S is determined using Equation (15.2). Then the initial 
azimuth of line RU is computed by subtracting 0 ] from the azimuth 
of line RS. 


A"rs = tan- 


x „ - x. 


= tan 1 { 


+ C = tan 


,y s -y r , 

+ 180° = 147°42'34" 


865.40-2432.55 


V 4527.15 - 2047.25 - 


Az RUo = 147°42'34" - 50°06'50" = 97°35'44" 

(c) Using the law of sines with triangle RUS, an initial length for RU 0 
can be calculated as 


RU n = 


RS sin 6h 


sin (180° - 6», -e 2 ) 
= 6049.00 ft 


2933.58 sin (l00°30 / 47 // ) 
sin (28°27 / 23") 
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(d) Using the azimuth and distance for RU 0 computed in steps 1(b) and 
1(c), initial coordinates for station U are computed as 

x Uo = x r + RU 0 sin Az RUo = 865.40 + 6049.00 sin (97°35'44") 

= 6861.35 

y Uo =y r + RU 0 cos A= RUt = 865.40+ 6049.00 cos (97°35'44") 

= 3727.59 

(e) Using the appropriate coordinates, the initial distances for SU and 
TU are calculated as 

SU 0 = \J (6861.35 - 2432.55) 2 + (3727.59 - 2047.25) 2 
= 4736.83 ft 

TU 0 = \J (6861.35 - 2865.22) 2 + (3727.59 - 27.15) 2 
= 5446.29 ft 


Step 2: Formulate the linearized equations. As in the trilateration adjust¬ 
ment, control station coordinates are held fixed during the adjustment 
by assigning zeros to their dx and dy values. Thus, these terms drop out 
of prototype Equation (15.13). In forming the observation equations, b, 
i, and/are assigned to the backsight, instrument, and foresight stations, 
respectively, for each angle. For example, with angle 8 X , B , /, and F are 
replaced by U, R, and S, respectively. By combining the station substitu¬ 
tions shown in Table 15.2 with prototype Equation (15.13), the following 
observation equations are written for the four observed angles. 




+ Vj 



+ v 2 


+ 180° 


+ V3 
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TABLE 15.2 Substitutions 


Angle 

B 

I 

F 

9i 

U 

R 

S 

02 

R 

S 

U 

^3 

U 

S 

T 

0 A 

S 

T 

U 



+ v 4 


Substituting the appropriate values into Equations (15.14) and multiplying 
the left side of the equations by p , to, achieve unit consistency, 1 the following 
J and K matrices are formed. 


J = p 


4527.15- 3727.59 6861.35 - 865.40 


6049.00 2 

6049.00 2 

3727.59 - 2047.25 

2432.55 - 6861.35 

4736.83 2 

4736.83 2 

2047.25 - 3727.59 

6861.35 -2432.55 


4736.83 


4736.83 


4.507 33.800 

15.447 -40.713 
-15.447 40.713 

25.732 -27.788 


3727.59- 27.15 2865,22 - 6861,35 

5446.29 2 5446.29 2 


50°06'50" - [tan” 1 

/ 2432.55 - 865.40 \ 

- tan -1 

/ 6861.35- 865.40 

)+«•] 

V 2047.25- 4527.15 / 

V 3727.59-4527.15 

101°30'47" - [tan- 

i / 6861.35- 2432.55 \ 

- tan - 

! / 865.40 - 2432.55 

) +0 1 

\ 3727.59-2047.25/ 

V4527.15-2047.25 

98°41'17" - [tan” 1 ( 

•2865.22- 2432.55 \ 

tan -1 ( 

6861.35 — 2432.55 \ 

+ 180°] 

- 27.15 -2047.25 / 

,3727.59- 2047.25/ 

59°17'01" - [tan- 1 

/ 6861.35- 2865.22 \ 

- tan -1 

/ 2432.55 - 2865.22 

)-°1 

V 3727.59-27.15 / 

V 2047.25-27.15 


0 . 00 "' 
0 . 00 " 
-0.69" 
-20.23" 


1 In order for these observations to be dimensionally consistent, the elements of the K and 
V matrices must be in radian measure, or in other words, the coefficients of the K and J elements 
must be in the same units. Since it is most common to work in the sexagesimal system, and since the 
magnitudes of the angle residuals are generally in the range of seconds, the units of the equations 
are converted to seconds by (1) multiplying the coefficients in the equation by p, which is the 
number of seconds per radian, or 206,264.8"/rad, and (2) computing the K elements in units of 
seconds. 
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Notice that the initial coordinates for jc and y U(j were calculated using 
and 0 2 , and thus their AT-matrix values are zero for the first iteration. These 
values will change in subsequent iterations. 

Step 3: Matrix solution. The least squares solution is found by applying 
Equation (11.37). 


/'/ = 


1159.7 

-1820.5 


Q XX = (J T J) 


-i 


-1820.5 

5229.7 

0.001901 

0.000662 


0.000662 

0.000422 


J'K 


-509.9 

534.1 

-l 


x= ( j T jy l (. j t k) 


dx u 

dy u 


0.001901 

0.000662 


0.000662 

0.000422 



-509.9' 


534.1 


dx u = -0.62 ft and dy u = — 0.11ft 

Step 4: Add the corrections to the initial coordinates for station U. 

x u = x u 0 + dx u — 6861.35 - 0.62 = 6860.73 


y u =y u + dy u = 3727.59 -0.11 = 3727.48 


(15.15) 


Step 5: Repeat Steps 2 through 4 until negligible corrections occur. The 
next iteration produced negligible corrections, and thus Equations (15.15) 
produced the final adjusted coordinates for station U. 

Step 6: Compute post-adjustment statistics. The residuals for the angles are 


V = JX — K ■■ 


4.507 

15.447 

-15.447 

25.732 


33.80 

-40.713 

40.713 

-27.788 


-0.62 

- 0.11 


0.00"' 


-6.5" ~ 

0.00" 


-5.1" 

-0.69" 


5.8" 

-20.23" 


1 

1_ 


The reference standard deviation for the adjustment is computed using 
Equation (12.14) as 

_ -6.5' 

V T V = \ -6.5 -5.1 5.8 7.3] 

7.3 


= [155.2] 
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m — n 


V T V 



The estimated errors for the adjusted coordinates of station U, given by 
Equation (13.24), are 


S Xu = S 0 ^Jq Vii = ±8.8 V0-001901 = ±0.38 ft 


S yu = S 0 yJQ Xu y u = ±8.8V0.000422 = ±0.18 ft 


The estimated error in the position of station U is given by 



15.5 ADJUSTMENT OF RESECTIONS 

Resection is a method used for determining the unknown horizontal 
position of an occupied station by observing a minimum of two horizon¬ 
tal angles to a minimum of three stations whose horizontal coordinates are 
known. If more than three stations are available, redundant observations are 
obtained and the position of the unknown occupied station can be computed 
using the least squares method. Like intersection, resection is suitable for 
locating an occasional station and is especially well adapted over inaccessible 
terrain. This method is commonly used for orienting total station instruments 
in locations favorable for staking projects by radiation using coordinates. 

Consider the resection position computation for the occupied station U 
of Figure 15.4 having observed the three horizontal angles shown between 
stations P, Q, R , and S whose positions are known. To determine the posi¬ 
tion of station U, two angles could be observed. The third angle provides 
a check and allows a least squares solution for computing the coordinates 
of station U. 



P 


Q 


U 


A R 


S 


FIGURE 15.4 Resection example. 
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Using prototype Equation (15.13), a linearized observation equation can 
be written for each angle. In this problem, the vertex station is occupied 
and is the only unknown station. Thus, all coefficients in the Jacobian 
matrix follow the form used for the coefficients of dx l and dy t in prototype 
Equation (15.13). The method of least squares yields corrections, dx u and dy u , 
which gives the most probable coordinate values for station U. 

15.5.1 Computing Initial Approximations in the Resection Problem 

In Figure 15.4, only two angles are necessary to determine the coordinates of 
station U. Using stations P, Q, R , and U, a procedure to find the station C/’s 
approximate coordinate values is 

Step 1: Let 

ZQPU + zURQ =G = 360° - (z 1 + z2 + zRQP ) (15.16) 

Step 2: Using the sine law with triangle PQU, 

QU = _PQ_ , 

sin zQPU sinzl 


and with triangle URQ, 


QU = QR 
sin z URQ sin z2 


Step 3: Solving Equations (a) and (b) for QU and setting the resulting 
equations equal to each other yields 


PQ sin zQPU QRsinzURQ 
sinzl sinz2 

Step 4: From Equation (c), let H be defined as 

sin z QP U QR sin z 1 
sin z URQ PQ sin z2 

Step 5: From Equation (15.16), 

zQPU = G - zURQ 


(c) 


(15.17) 


(d) 


Step 6: Solving Equation (15.17) for the sin zQPU, and substituting 
Equation (d) into the result yields 


(e) 


sin (G - z URQ) = H sin z URQ 
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Step 7: From trigonometry: 

sin (a - (!) = sin a cos /? - cos a sin /? 

Applying this relationship to Equation (e), 

sin (G - z URQ) = sin G cos z URQ - cos G sin z URQ (f ) 

sin (G - z URQ) = H sin z URQ (g) 


Step 8: Dividing Equation (g) by cos z URQ and rearranging yields 


sin G = tanzURQ \H + cos (G)] (h) 

Step 9: Solving Equation (h) for zURQ gives 

ZURQ = tan- 1 ( S ‘ n(G) ) (15.18) 

\H + cos (G) / 

Step 10: From Figure 15.4, 

zRQU — 180° - (z2 + z URQ) (15.19) 


Step 11: Again applying the sine law yields 

QR sin zRQU 

RU = —-:-(15.20) 

sm z2 

Step 12: Finally, the initial coordinates for station U are 

x u = x r + RU sin ( Az R q - z URQ ) 

y u =y r + RU cos (Az rq - zURQ) (15.21) 

Example 15.2 The following data are obtained for Figure 15.4. Con¬ 
trol stations P, Q, R , and S have the following (x, y) coordinates: P 
(1303.599, 1458.615), Q (1636.436, 1310.468), R (1503.395, 888.362), and S 
(1506.262, 785.061). The observed values for angles 1, 2, and 3 with standard 
deviations are 


Backsight 

Occupied 

Foresight 

Angle 

sn 

P 

U 

Q 

30°29'33" 

±5 

Q 

U 

R 

38°30 / 31" 

±6 

R 

u 

S 

10°29 / 57" 

±6 


What are the most probable coordinates of station U1 
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SOLUTION Using the procedures described in Section 15.5.1, the initial 
approximations for the coordinates of station U are: 

(a) From Equation (15.10), 

zRQP = Az PQ - Az qr = 293°59'38.4" - 197°29'38.4" = 96°30'00.0" 

(b) Substituting the appropriate angular values into Equation (15.16), yields 

G = 360° - (30°29'33" + 38°30'3l" + 96°30'00.0") = 194°29'56" 


(c) Substituting the appropriate station coordinates into Equation (14.1) 
yields 


PQ - 364.318 and <2^ = 442.576 


(d) Substituting the appropriate values into Equation (15.17) yields H as 

442.576 sin (30°29'33") 

H =---- = 0.990027302 

364.318 sin (38°30'31") 

(e) Substituting previously determined G and H into Equation (15.18), 
zURQ is computed as 


Z.URQ- tan 1 


sin (l94°29 / 56") 


0.990027302 + cos (194°29'56") 
= -85°00'22.2" + 180° = 94°59'36.3" 


| + 180° 


(f) Substituting the value of Z.URQ into Equation (15.19), zRQU is deter¬ 
mined to be 


zRQU= 180° - (38°30 / 3l" + 94°59'36.3") = 46°29'52.7" 


(g) From Equation (15.20), RU is 


RU = 


442.576 sin (46°29'52.7") 
sin (38°30 / 31") 


515.589 


(h) Using Equation (15.1), the azimuth of RQ is 

, + _j / 1636.436 - 1503.395 \ 

Az rq = ‘an ( i3io.468- 888.362 ) 


+ 0° = 17°29'38.4" 
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(i) From Figure (15.4), Az RU is computed as 

Az rq = 197°29'38.4" - 180° = 17°29'38.4" 

Az ru = Az rq - zURQ = 360° + 17°29'38.4" - 94°59'36.3" 

= 282°30 / 02.2" 

(j) Using Equation (15.21), the coordinates for station U are 

x u = 1503.395 + 515.589 sin (AzRU) = 1000.03 
y u = 888.362 + 515.589 cos (AzRU) = 999.96 

For this problem, using prototype Equation (15.13), the J and K matrices 
are 


J = P 


y P -y u y q -y u 


UP 2 


UQ 2 


y q -y u y r - y u 


UR 2 


( 


UQ 2 7 0 

y r -y u y s -y u 


K = 


UR 2 US 2 

(^-A>n 

(z2-z2 0 )" 
L(^3-z3 0 )". 


Xu ~ X p X u ~ X q 


UP 2 
x„ - x„ 


UQ 2 /o 

X„ - X, ' 


X ( 


2 UR 2 

X u ~ X r X u ~ x . 


UQ 1 — y 0 


UR 2 


US 2 


X\ 


Also, the weight matrix IFis a diagonal matrix composed of the inverses of the 
variances for the observed angles, or 


W = 


\ 0 
5 ! 
0 4 
6 2 

0 0 


Using the data given for the problem, together with the computed initial 
approximations, numerical values for the matrices were calculated and the 
adjustment performed using program ADJUST. A file named Adjust file for 
Example 15-2.dat is on the companion website. The following results were 
obtained after two iterations. The reader is encouraged to adjust these example 
problems using both the MATRIX and ADJUST programs supplied. 
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ITERATION 1 


3 MATRIX 


K MATRIX 

X MATRIX 

184.993596 

54.807717 

-0.203359 

-0.031107 

214.320813 

128.785353 

-0.159052 

0.065296 

59.963802 

-45.336838 

-6.792817 


ITERATION 2 

3 MATRIX 


K MATRIX 

X MATRIX 

185.018081 

54.771738 

1.974063 

0.000008 

214.329904 

128.728773 

-1.899346 

0.000004 

59.943758 

-45.340316 

-1.967421 


INVERSE MATRIX 



0.00116318 - 

0.00200050 



-0.00200050 

0.00500943 



* * * * * * * * * * * * * * 

* * * 



Adjusted stations 

A A A A A A A A A A A A A A A A A 



Station 

X 

Y 

Sx Sy 

U 999 

.999 1,000 

.025 0. 

0206 0.0427 


Adjusted Angle Observations 


Station Station Station 


Backsighted 

Occupied 

Foresighted 

Angle 

V 

S (") 

P 

U 

Q 

30”29'31" 

-2.0" 

ro 

rsi 

Q 

U 

R 

38°30'33" 

1.9" 

3.1 

R 

U 

S 

10” 2 9'5 9" 

2.0" 

3.0 


* * * * * * * Vc * * * Vc * * * Vc * * *V * * * 

Adjustment Statistics 

•A. Jk JU >'• J. J. A A A >'* A A A A A A A A A A A 

Redundancies = 1 
Reference Variance = 0.3636 
Reference So = ±0.60 


15.6 ADJUSTMENT OF TRIANGULATED QUADRILATERALS 

The quadrilateral is the basic figure for triangulation. Procedures like 
those used for adjusting intersections and resections are also used to adjust 
this figure. In fact, the parametric adjustment using the observation equation 
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method can be applied to any triangulated geometric figure, regardless of 
its shape. 

The procedure for adjusting a quadrilateral consists in first using a mini¬ 
mum number of the observed angles to solve triangles and computing initial 
values for the coordinates. Corrections to these initial coordinates are then cal¬ 
culated by applying the method of least squares. The procedure is iterated until 
the solution converges. This yields the most probable coordinate values. A sta¬ 
tistical analysis of the results is then made. The following example illustrates 
the procedure. 

Example 15.3 The following observations are supplied for Figure 15.5. Adjust 
this figure by the method of least squares. Assume equal weights for the angles. 
The observed angles (assume equal weights) are as follows: 

1 = 42°35'29.0" 3 = 79°54'42.1" 5 = 21°29'23.9" 7 = 31°20'45.8" 

2 = 87°35'10.6" 4= 18°28 / 22.4" 6 = 39°01'35.4" 8 = 39°34'27.9" 

The fixed coordinates are 

x A — 9,270.33 y A = 8,448.90 ^ = 15,610.58 y D = 8,568.75 



FIGURE 15.5 Quadrilateral example. 

SOLUTION The coordinates of station B and C are to be computed in this 
adjustment. The Jacobian matrix has the form shown in Table 15.3. The sub¬ 
scripts b, i, and /of the dx\ s and dy’s in Table 15.3 indicate whether stations 
B and C are the backsight, instrument, or foresight station in Equation (15.13). 
Of course, in developing the coefficient matrix, the appropriate station coordi¬ 
nate substitutions must be made to obtain each coefficient. 

The reader is encouraged to review this example in the spreadsheet file 
Chapter 15.xls. In this spreadsheet the cells are named, which allows the coef¬ 
ficients to be entered in an understandable manner. Additionally, the matrices 
are setup in a manner that allows them to be copied directly into MATRIX. 
In MATRIX, the unweighted least squares adjustment option in the numerical 
operations menu is used to quickly obtain solution. The resulting X matrix 
is copied into the spreadsheet where it is placed in the appropriate cells to 
update the coordinates for stations B and C. Figure 15.4 shows the portion 
of the spreadsheet where the final coordinates are updated. Notice how the 
initial coordinate values are summed to the cell labeled as Final. Once the 
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TABLE 15.3 Structure of the Coefficient or J Matrix in Example 15.3 


Angle 


Unknowns 


dx b 

dy b 

dx c 

dy c 

1 

dx{b) 

dy(b) 

dxif) 

dyif) 

2 

0 

0 

dx(b) 

dy(b) 

3 

dx(i) 

dy(i) 

dx{b) 

dy{b) 

4 

dx(i) 

dy(i) 

0 

0 

5 

0 

0 

dx(i) 

dyif) 

6 

dxif) 

dyif) 

dx(i) 

dyif) 

7 

dx(f 

dy(J) 

0 

0 

8 

dy(b) 

dv{b ) 

dxif) 

dyif) 


coordinates are updated, the J and K matrices are updated immediately. This 
process is repeated until the final solution is confirmed in the second iteration. 
Following the solution convergence, the V, Sxx, Sll , and reference variance 
matrices are copied into the spreadsheet. These matrices are used to compute 
the post-adjustment statistics shown in Figures 15.6 and 15.7. 


Example 15.3 set up for MATRIX 









Control 

A 

D 





X 

9270 330 

15610 580 





y 

8448 900 

8568.750 












Unknowns 

x e 

0 

1 

2 

3 

Final 

S 

2403 600 

-0.01115 

0000 

2403 589 

±0 469 

y B 

16275 400 

0 04946 

0 000 

16275 449 

±0 490 

*c 

9649 800 

006188 

0 000 

9649 862 

±0 345 

yc 

24803.500 

003693 

0.000 

24803.537 

±0 8qa 


FIGURE 15.6 Portion of the spreadsheet for Example 15.3. 


Angles 

Observed 


Adjusted V S 

BAC 

42° 

35' 

29 0" 

42° 35' 31.1" 2 1" ±3 6" 

CAD 

87° 

35' 

10.6" 

87° 35' 15.6" 5.0" ±4.3" 

CBD 

79° 

54' 

42.1" 

79° 54' 37 9” -4.2” ±4.3" 

DBA 

18° 

PO 

CO 

22 4" 

18° 28' 21 0" -1.4" ±3.4" 

DCA 

21° 

29' 

23.9" 

21° 29' 25.7" 1.8" ±3.8" 

ACB 

39° 

or 

35.4" 

39° 01' 30.0" -5.4" ±4.4" 

ADB 

31° 

o 

CVJ 

45.8" 

31° 20' 52.3" 6.5" ±4.2" 

BDC 

39° 

34' 

27.9" 

39° 34' 26 4" -1.5” ±3.5" 






So 

±5.6 

r*" 


FIGURE 15.7 Portion of the spreadsheet for Example 15.3. 
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The following self-explanatory computer listing is from ADJUST. It was 
created using the hie Adjust file for Example 15-3.dat, which is on the com¬ 
panion website. As shown, a single iteration was satisfactory to achieve 
convergence, since the second iteration produced negligible corrections. Resid¬ 
uals, adjusted coordinates, their estimated errors, and adjusted angles are 
tabulated at the end of the listing. 


Initial approximations for unknown stations 
Station X Y 


B 2,403.600 16,275.400 

C 9,649.800 24,803.500 

Control Stations 


Station 


X 


Y 


A 9,270.330 8,448.900 

D 15,610.580 8,568.750 


Angle Observations 


Station 
Backsighted 


Station 
Occupied 


Station 
Foresighted 


Angl e 



B 

A 


c 

42°35'29.0" 


c 

A 


D 

87°35'10.6" 


c 

B 


D 

79° 54'42.1" 


D 

B 


A 

18°28'22.4" 


D 

c 


A 

21°29'23.9” 


A 

c 


B 

39°01'35.4" 


A 

D 


B 

31°20'45.8" 


B 

D 


C 

39°34'27.9" 

teration 1 






Matrix 




K MATRIX 

X MATRIX 

14.891521 

-13.065362 

12.605250 

-0.292475 

-1.811949 

1 -0.011149 

0.000000 

0.000000 

-12.605250 

0.292475 

-5.801621 

2 0.049461 

20.844399 

-0.283839 

-14.045867 

11.934565 

3.508571 

3 0.061882 

8.092990 

1.414636 

0.000000 

0.000000 

1.396963 

4 0.036935 

0.000000 

0.000000 

1.409396 

-4.403165 

-1.833544 


14.045867 

11.934565 

1.440617 

-11.642090 

5.806415 


6.798531 

11.650726 

0.000000 

0.000000 

-5.983393 


6.798531 

-11.650726 

11.195854 

4.110690 

1.818557 
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Iteration 2 

J Matrix K MATRIX X MATRIX 


14.891488 

0.000000 

20.844296 

8.092944 

0.000000 

14.045752 

6.798544 

6.798544 


-13.065272 

0.000000 

-0.283922 

1.414588 

0.000000 

11.934605 

11.650683 

-11.650683 


12.605219 

-12.605219 

-14.045752 

0.000000 

1.409357 

1.440533 

0.000000 

11.195862 


-0.292521 

0.292521 

11.934605 

0.000000 

-4.403162 

-11.642083 

0.000000 

4.110641 


-2.100998 

-5.032381 

4.183396 

1.417225 

-1.758129 

5.400377 

-6.483846 

1.474357 


1 0.000000 
2 - 0.000000 

3 0.000000 

4 -0.000001 


INVERSE MATRIX 


0.00700 -0.00497 
■0.00497 0.00762 
0.00160 0.00148 
■0.01082 0.01138 


0.00160 -0.01082 
0.00148 0.01138 

0.00378 0.00073 

0.00073 0.02365 


Adjusted stations 

* * * * * * it it it it it it it it it it it it 


Station 

X 


Y 

Sx 

Sy 

B 

2,403.589 

16,275.449 

0.4690 

0.4895 

C 

9,649.862 

24,803.537 

0.3447 

0.8622 

it it it it it it it it it it it it it it it it it it it it it it it it it it it 

Adjusted Angle Observations 

it it it it it it it it it it it it it it it it it it it it it it it it it it it 

Station Station Station 

Backsighted Occupied Foresighted 

Angl e 

V 

S 

B 

A 

C 

42°35'31.1" 

2.10" 

3.65 

C 

A 

D 

87°35'15.6" 

5.03" 

4.33 

C 

B 

D 

79°54'37.9" 

-4.18" 

4.29 

D 

B 

A 

18°28'21.0" 

-1.42" 

3.36 

D 

C 

A 

21°29'25.7" 

1.76" 

3.79 

A 

C 

B 

39°01'30.0" 

-5.40" 

4.37 

A 

D 

B 

31°20'52.3" 

6.48" 

4.24 

B 

D 

C 

39°34'26.4" 

-1.47" 

3.54 


it it it it it it it it it it it 

it it it it it it it 

it it it it it it it it it it it 

it it it it it it it it it 

it it it it it it 


it it it it it it it it it it it 

* * * * it it it 

Adjustment 

it it it it it it it it it it it 

Statistics 

it it it it it it it it it it it it it it it 


Iterations = 2 
Redundancies = 4 

Reference Variance = 31.42936404 
Reference So = ±5.6062 
Convergence! 
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PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

*15.1 Given the following observations and control station coordinates to 
accompany figure, what are the most probable coordinates for station 
E using an unweighted least squares adjustment? 


Control Stations 


Station 

x (ft) 

P(ft) 

A 

10,000.00 

10,000.00 

B 

11,498.58 

10,065.32 

C 

12,432.17 

11,346.19 

D 

11,490.57 

12,468.51 


Angle Observations 


Backsight ( b ) 

Occupied (z) 

Foresight (f) 

Angle 

5 H 

E 

A 

B 

90°59'57" 

±3.3 

A 

B 

E 

40°26 / 02" 

±3.7 

E 

B 

C 

88°08'55" 

±3.9 

B 

C 

E 

52°45 / 02" 

±3.7 

E 

C 

D 

51°09'55" 

±3.8 

C 

D 

E 

93° 13'14" 

±4.0 



FIGURE P15.1 

15.2 Repeat Problem 15.1 using a weighted least squares adjustment with 
weights of 1 IS 2 for each angle. What are the: 

(a) Most probable coordinates for station E and their standard 
deviations? 

(b) Reference standard deviation of unit weight? 

(c) Adjusted angles, their residuals, and standard deviations? 
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15.3 Given the following observations and control station coordinates to 
accompany Figure 15.3, what are the: 

(a) Most probable coordinates for station E and their standard 
deviations? 

(b) Reference standard deviation of unit weight? 

(c) Adjusted angles, their residuals, and standard deviations? 


Control Stations 


Station 

Easting (m) 

Northing (m) 

R 

6,735.656 

6,061.097 

S 

6,894.607 

5,517.132 

T 

6,693.269 

4,920.183 


Angle Observations 


Backsight ( b ) 

Occupied (/) 

Foresight (/) 

Angle 

S(") 

U 

R 

S 

49°07'42" 

±4.6 

R 

S 

U 

103°13'02" 

±4.9 

U 

S 

T 

1H°42'34" 

±4.6 

s 

T 

U 

41°26 / 28" 

±4.3 


*15.4 Given the following observed angles and control coordinates for the 
resection problem of Figure 15.4. 

1 = 12°54'32" 2 = 65°23'42" 3 = 11 0 44'38" 

Assuming equally weighted angles, what are the most probable coordi¬ 
nates for station [/? 


Control Stations 


Station 

A (ft ) 

A (ft) 

P 

9000.00 

9000.00 

Q 

9000.00 

7500.00 

R 

9000.00 

2500.00 

S 

9000.00 

1200.00 


15.5 If the estimated standard deviations for the angles in Problem 15.4 are 
Sj = ±4.5", S 2 = ±4.3", and S 3 = ±3.6", what are the: 

(a) Most probable coordinates for station U and their standard 
deviations? 

*(b) Reference standard deviation of unit weight? 

(c) Adjusted angles, their residuals, and standard deviations? 
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15.6 Repeat Problem 15.5 using the following data. 


Control Stations 


Station 

x (ft) 

U(ft) 

P 

8,593.99 

8,170.60 

Q 

8,812.99 

7,566.58 

R 

9,145.02 

7,170.97 

S 

9,014.33 

6,711.78 

Angle Observations 


Backsight ( b ) 

Occupied (/) 

Foresight (/) 

Angle 

S(") 

P 

U 

Q 

22°52'35" 

±5.4 

Q 

u 

R 

20°49'45" 

±5.0 

R 

u 

S 

18°54'10" 

±6.2 


15.7 Using approximate (x, y ) coordinates for station E of (24,514.027, 
23,409.472), and given the following control coordinates and observed 
angles for an intersection problem: 


Control Stations 


Station 

X(m) 

Y (m) 

A 

643.154 

8,213.066 

B 

1,093.916 

37,422.484 

C 

37,515.536 

37,061.874 

D 

39,408.739 

7,491.846 


Angle Observations 


Backsight 

Occupied 

Foresight 

Angle 

sn 

E 

A 

D 

33°32'48" 

±3.5 

E 

B 

A 

59°59'24" 

±3.5 

E 

C 

B 

46°57'58" 

±3.5 

E 

D 

C 

39°26'00" 

±3.5 
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What are the: 

(a) Most probable coordinates for station E and their standard 
deviations? 

(b) Reference standard deviation of unit weight? 

(c) Adjusted angles, their residuals, and standard deviations? 

15.8 The following control station coordinates, observed angles and stan¬ 
dard deviations apply to the quadrilateral in Figure 15.5. 


Control Stations 


Initial Approximations 


Station 

A (ft) 

Y (ft) 

Station 

A (ft) 

Y (ft) 

A 

1536.43 

210.86 

B 

176.67 

2801.09 

D 

3798.06 

205.98 

C 

2355.54 

2826.52 


Angle Observations 

Backsight 

Occupied 

Foresight 

Angle 

so 

B 

A 

C 

45°24'8" 

±3.7 

C 

A 

D 

72°44'00" 

±3.7 

C 

B 

D 

36°17'38" 

±3.7 

D 

B 

A 

26°40'40" 

±3.6 

D 

C 

A 

46° 13'13" 

±3.7 

A 

C 

B 

71°56'40" 

±3.7 

A 

D 

B 

35°30'04" 

±3.7 

B 

D 

C 

25°32'33" 

±3.6 


Do a weighted adjustment using the standard deviations to calculate 
weights. What are the 

*(a) Most probable coordinates for stations B and C and their stan¬ 
dard deviations? 

(b) Reference standard deviation of unit weight? 

(c) Adjusted angles, their residuals, and standard deviations? 

15.9 For the accompanying figure and the following observations, perform 
a weighted least squares adjustment. 

(a) Station coordinates and standard deviations. 

(b) Angles, their residuals, and standard deviations. 
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Control Stations 


Station 

X(m) 

Y (m) 

A 

600.544 

966.236 

B 

1061.624 

4043.173 


Initial Approximations 


Station 

X(m) 

Y (m) 

C 

3969.023 

4112.018 

D 

3860.927 

955.098 


Angle Observations 


Backsight 

Occupied 

Foresight 

Angle 

sn 

B 

A 

C 

38°26'08" 

±2.2 

C 

A 

D 

43°14'15" 

±2.1 

C 

B 

D 

49°09'52" 

±2.2 

D 

B 

A 

50°42'47" 

±2.2 

D 

C 

A 

44°59'51" 

±2.2 

A 

C 

B 

41°41'08" 

±2.2 

B 

D 

C 

44°09'07" 

±2.2 

A 

D 

B 

47°36'44" 

±2.2 


15.10 Do Problem 15.9 using the additional horizon closure angles listed 
below. 

Backsight 

Occupied 

Foresight 

Angle 

sn 

D 

A 

B 

278°19'38" 

±2.2 

A 

B 

C 

260°07'18" 

±2.2 

B 

C 

D 

273°19'38" 

±2.2 

C 

D 

A 

268°14'03" 

±2.2 
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(a) Station coordinates and standard deviations. 

(b) Angles, their residuals, and standard deviations. 

(c) Compare and discuss any differences or similarities between these 
results and those obtained in Problem 15.9. 

15.11 The following observations were obtained for a triangulation chain 
shown in the accompanying figure. 


Control Stations Initial Approximations 


Station 

X(m) 

Y( m) 

Station 

X (m) 

Y{ m) 

A 

1718.871 

632.095 

C 

1668.571 

1310.429 

B 

2191.570 

715.709 

D 

2139.109 

1296.242 

G 

1590.370 

2560.743 

E 

1617.479 

1649.217 

H 

2076.006 

2597.745 

F 

2028.688 

1934.566 


Angle Observations 


B 

I 

F 

Angle 

so 

B 

I 

F 

Angle 

so 

C 

A 

D 

36°33'50" 

±4.1 

D 

E 

C 

47°20T2" 

±7.0 

D 

A 

B 

47°38'41" 

±5.1 

F 

E 

D 

68°50'37" 

±5.4 

A 

B 

C 

58°42'10" 

±5.2 

D 

F 

C 

39°48'02" 

±4.4 

C 

B 

D 

36°09'45" 

±4.5 

C 

F 

E 

25° 15'23" 

±5.1 

D 

C 

B 

46°56'47" 

±5.2 

H 

E 

F 

29°26'35" 

±4.7 

B 

C 

A 

37°05T4" 

±4.1 

G 

E 

H 

27°30'09" 

±3.1 

B 

D 

A 

37°29T9" 

±4.5 

E 

F 

G 

89°45'54" 

±5.1 

A 

D 

C 

59°24'16" 

±5.2 

G 

F 

H 

39°04'24" 

±4.2 

E 

C 

F 

38°33'24" 

±6.8 

H 

G 

F 

59°2T56" 

±5.2 

F 

C 

D 

61°44'32" 

±5.4 

F 

G 

E 

33°17T4" 

±3.6 

C 

D 

E 

32°21'36" 

±5.5 

F 

H 

E 

21°43 , 05" 

±3.8 

E 

D 

F 

46°05'58" 

±4.7 

E 

H 

G 

59°50'37" 

±4.8 


Use ADJUST to perform a weighted least squares adjustment. 
Tabulate the final adjusted 

(a) Station coordinates and their standard deviations. 

(b) Angles, their residuals, and standard deviations. 
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15.12 Add the following horizon closure angles to the data in Problem 15.11 
and use the program ADJUST to perform the adjustment. 


B 

I 

F 

Angle 

5 H 

B 

A 

C 

275°47'22" 

±5.6 

A 

C 

E 

175°40'06" 

±7.3 

C 

E 

G 

186°52'52" 

±6.9 

E 

G 

H 

267°20'44" 

±5.2 

G 

H 

F 

278°26'18" 

±5.6 

H 

F 

D 

166°06'12" 

±5.0 

F 

D 

B 

184°39'06" 

±5.3 

D 

B 

A 

265°07'57" 

±6.0 
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(a) Station coordinates and their standard deviations. 

(b) Angles, their residuals, and standard deviations. 

(c) Compare and discuss any differences or similarities between these 
results and those obtained in Problem 15.11. 

15.13 Using the control coordinates from Problem 14.3 and the following 
angle observations, compute the least squares solution and tabulate the 
final adjusted 

(a) Station coordinates and their standard deviations. 

(b) Angles, their residuals, and standard deviations. 


Angle Observations 


Backsight 

Occupied 

Foresight 

Angle 

SCO 

B 

A 

C 

60°00 / 34" 

±3.3 

C 

A 

D 

59°59'23" 

±2.9 

C 

B 

D 

43°04 / 22" 

±2.8 

C 

B 

A 

79°07'27" 

±3.4 

D 

C 

A 

58°17'31" 

±2.9 

A 

C 

B 

40°51'51" 

±3.0 

A 

D 

B 

23°56'43" 

±2.7 

B 

D 

C 

37°46 / 19" 

±2.7 


15.14 The following observations were obtained for a triangulation chain. 


Control Stations Initial Approximations 


Station 

A (ft) 

Y (ft) 

Station 

A (ft) 

Y (ft) 

A 

3,190.04 

8,433.74 

B 

3,711.26 

10,408.62 

D 

3,671.87 

14,314.29 

C 

3,981.71 

12,055.36 

H 

7,475.32 

8,437.20 

E 

5,491.00 

9,032.76 

K 

7,590.44 

14,142.31 

F 

5,509.17 

11,145.10 




G 

5,519.02 

13,102.09 




I 

7,213.18 

10,377.56 




J 

7,311.66 

12,317.91 
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Angle Observations 


B 

I 

F 

Angle 

sn 

B 

I 

F 

Angle 

sn 

B 

A 

E 

60°37'23" 

±1.7 

J 

F 

I 

57°17'59" 

±1.8 

E 

B 

A 

67°04'41" 

±1.7 

I 

F 

E 

66°14'38" 

±1.8 

F 

B 

E 

59°58'55" 

±1.7 

E 

F 

B 

67°13'52" 

±1.8 

C 

B 

F 

58°23'48" 

±1.9 

A 

E 

B 

52°17'56" 

±1.6 

F 

C 

B 

68°32'07" 

±2.0 

B 

E 

F 

52°47'11" 

±1.7 

G 

C 

F 

65°02'32" 

±1.9 

F 

E 

I 

51°31'17" 

±1.7 

D 

C 

G 

63°33'32" 

±1.8 

I 

E 

H 

51°41'29" 

±1.7 

G 

D 

C 

48°54'53" 

±1.7 

H 

E 

A 

148°42'06" 

±1.7 

D 

G 

K 

120°03'38" 

±1.7 

E 

H 

I 

65°35'58" 

±1.8 

K 

G 

J 

50°17'30" 

±1.7 

H 

I 

E 

59°42'34" 

±1.8 

J 

G 

F 

66°39'44" 

±1.8 

E 

I 

F 

62°14'01" 

±1.8 

F 

G 

C 

55°27'39" 

±1.8 

F 

I 

J 

68°39'25" 

±1.9 

C 

G 

D 

67°31'30" 

±1.8 

I 

J 

F 

54°02'38" 

±1.8 

B 

F 

C 

53°04'04" 

±1.9 

F 

J 

G 

56°40'36" 

±1.8 

C 

F 

G 

59°29'48" 

±1.9 

G 

J 

K 

75°03'42" 

±1.9 

G 

F 

J 

56°39'38" 

±1.8 

J 

K 

G 

54°38'50" 

±1.8 


Use ADJUST to perform a weighted least squares adjustment. Tabu¬ 
late the final adjusted 

(a) Station coordinates and their standard deviations. 

(b) Angles, their residuals, and standard deviations. 

15.15 Add the following horizon closure angles to the data in Problem 15.14 
and use the program ADJUST to perform the adjustment. 


B 

I 

F 

Angle 

sn 

B 

I 

F 

Angle 

sn 

E 

A 

B 

299°22'38" 

±1.7 

G 

K 

J 

305°21'11" 

±1.8 

A 

B 

C 

174°32'30" 

±2.0 

K 

J 

I 

174° 13'19" 

±1.9 

B 

C 

D 

162° 51'49" 

±1.9 

J 

I 

H 

169°24'02" 

±1.9 

C 

D 

G 

311°05'06" 

±1.7 

I 

H 

E 

294°24'00" 

±1.8 


(a) Station coordinates and their standard deviations. 

(b) Angles, their residuals, and standard deviations. 

(c) Compare the results of the adjustment with that of Problem 15.14. 
Use the ADJUST software to do the following problems. 


15.16 Problems 15.2. 

15.17 Problems 15.4. 
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15.18 Problem 15.5. 

15.19 Problems 15.6. 

15.20 Problems 15.8. 

15.21 Show that Equation (a) can be rearranged and regrouped to match 
Equation (15.13). 

PROGRAMMING PROBLEMS 

15.22 Write a computational program that computes the coefficients for pro¬ 
totype Equations (15.9) and (15.13), and their k values given the coor¬ 
dinates of the appropriate stations. Use this program to determine the 
matrix values necessary to do Problem 15.6. 

15.23 Prepare a computational program that reads a hie of station coordi¬ 
nates, observed angles, and their standard deviations and then 

(a) Writes the data to a hie in a formatted fashion. 

(b) Computes the /, K, and W matrices. 

(c) Writes the matrices to a hie that is compatible with the MATRIX 
program. 

(d) Test this program with Problem 15.6. 

15.24 Write a computational program that reads a hie containing the J, K , 
and W matrices and then 

(a) Writes these matrices in a formatted fashion. 

(b) Performs one iteration of either a weighted or unweighted least 
squares adjustment of Problem 15.6. 

(c) Writes the matrices used to compute the solution and the correc¬ 
tions to the station coordinates in a formatted fashion. 

15.25 Write a computational program that reads a hie of station coordinates, 
observed angles, and their standard deviations and then 

(a) Writes the data to a hie in a formatted fashion. 

(b) Computes the J, K , and W matrices. 

(c) Performs either a relative or equal-weight least squares adjustment 
of Problem 15.6. 

(d) Writes the matrices used to compute the solution, and tabulates the 
hnal adjusted station coordinates and their estimated errors, and 
the adjusted angles together with their residuals and their estimated 
errors. 

15.26 Prepare a computational program that solves the resection prob¬ 
lem. Use this program to compute the initial approximations for 
Problem 15.3. 


CHAPTER 16 


ADJUSTMENT OF HORIZONTAL 
SURVEYS: TRAVERSES AND 
HORIZONTAL NETWORKS 


16.1 INTRODUCTION TO TRAVERSE ADJUSTMENTS 

Of the many methods that exist for traverse adjustment, the characteristic that 
distinguishes the method of least squares from other methods is that distance, 
angle, and direction observations are adjusted simultaneously. Furthermore, 
the adjusted observations not only satisfy all geometrical conditions for the 
traverse, but they also provide the most probable values for the given set of 
data. Additionally, the observations can be weighted rigorously based on their 
estimated errors and adjusted accordingly. Given these facts, together with the 
computational power now provided by computers, it is hard to justify not using 
least squares for all traverse adjustment work. 

In this chapter, we describe methods for making traverse adjustments 
using the least squares method. As was the case in triangulation adjustments, 
traverses can be adjusted by least squares using either observation equations 
or conditional equations. Again, because of the relative ease with which the 
equations can be written and solved, the parametric observation equation 
approach will be discussed. 


16.2 OBSERVATION EQUATIONS 

When adjusting a traverse using parametric equations, an observation 
equation is written for each distance, direction, or angle. The necessary 
linearized observation equations developed previously are recalled in the 
following equations. 
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Distance observation equation: 



dxi + 
o 


yt-yj 


u 


dyj + 


JO 


Xj - x t 

IJ 


dxj + 
o 


yj-yt 

u 



- kj + Vj 


(16.1) 


Angle observation equation: 


Ji- yb\ , , ( x b~ x t\ , , (yb-yt y/~Vi , , 

dx b + , d }’h + ( ——;-—r- dx t 


+ 


IB - Jo " \ IB 1 

Xi - x b Xi - x f 


IB 1 


= kg + Vg 


IF 1 


dy t + 


o \ IB 

Vf-Vi 


o 


IF 2 


dxf + 
o 


IF /o 

x i x f 

IF~ 


dy f 


(16.2) 


Azimuth observation equation: 


yj-yj 

u 2 


dX: + 




u - 




IJ 2 


- k j- V At 

AZ ij ZiZ ij 


dx: + 
o 



dyj 

i 

(16.3) 


The reader should refer to Chapters 14 and 15 to review the specific nota¬ 
tion for these equations. As demonstrated with the examples that follow, the 
azimuth equation may or may not be used in traverse adjustments. 


16.3 REDUNDANT EQUATIONS 

As noted earlier, one observation equation can be written for each observed 
angle, distance, or direction in a closed traverse. Thus, if there are n sides in 
the traverse, there are n distances and n + 1 angles, assuming that one angle 
exists for orientation of the traverse. For example, each closed traverse in 
Figure 16.1 has four sides, four distances, and five angles. Each traverse also 
has three points whose positions are unknown, and each point introduces two 



FIGURE 16.1 (a) Polygon and (b) link traverses. 
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unknown coordinates into the solution. Thus, there are a maximum of 2 (n — 1) 
unknowns for any simple closed traverse. From the foregoing, no matter the 
number of sides, there will always be a minimum of r = (n + n + 1) - 2 (n — 1) 
= 3 redundant equations for any simple closed traverse. That is, every simple 
closed traverse that is fixed both positionally and rotationally in space has a 
minimum of three redundant equations. 

16.4 NUMERICAL EXAMPLE 

Example 16.1 To illustrate a least squares traverse adjustment, the simple link 
traverse shown in Figure 16.2 will be used. The spreadsheet file Chapter 16.xls 
containing this problem can be found on the companion website for this book. 
The observational data are: 


Distances (ft) Angles 


RU = 200.00 ± 0.05 G x = 240°00' ± 30" 

US = 100.00 ± 0.08 9~, = 150°00' ± 30" 

e\ = 240°or ± 30 " 



FIGURE 16.2 Simple link traverse. 


SOLUTION 

Step 1: Calculate initial approximations for the unknown station coordi¬ 
nates. 

x u = 1000.00 + 200.00 sin 60° = 1173.20 ft 
y Uo = 1000.00+ 200.00 cos 60° = 1100.00 ft 

Step 2: Formulate the XandKmatrices. The traverse in this problem contains 
only one unknown station with two unknown coordinates. The elements 
of the X matrix consist of the corrections to the coordinates of U, which 
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are the dx u and dy u terms. They are the unknown corrections to be applied 
to the initial approximations for the coordinates of station U. The values 
in the K matrix are derived by subtracting computed quantities, based 
on initial coordinates, from their respective observed quantities. Note 
that since the first and third observations were used to compute initial 
approximations for station U, their /5-matrix values will be zero in the 
first iteration. 



kRU 


' 200.00 ft - 200.00 ft 


■ 0.00 ft 


dx u 

dy u _ 


ksu 


100.00 ft-99.81 ft 


0.19 ft 

X = 

K = 

ke l 

= 

240°00'00" - 240°00'00" 

= 

0" 



kg 2 


150°00'00" - 149°55'51" 


249" 


kg 3 


24Q°01'00"-240°04'12" 


-192" 


Step 3: Calculate the Jacobian matrix. Since the observation equations are 
nonlinear, the Jacobian matrix must be formed to obtain the solution. 
The J matrix is formed using prototype Equations (16.1) for distances 
and (16.2) for angles. As explained in Section 15.4, since the units of the 
K matrix that relate to the angles are in seconds, the angle coefficients of 
the / matrix must be multiplied by p to also obtain units of seconds. 


In developing the /matrix using prototype Equations (16.1) and (16.2), sub¬ 
script substitutions were as shown in Table 16.1. Substitutions of numerical 
values and computation of the / matrix follow. 


j = 


j = 


1173.20- 1000.00 

1100.00- 1000.00 

200.00 

1173.20- 1223.00 

200.00 

1100.00- 1186.50 

99.81 

/ 1100.00- 1000.00 \ 

99.81 

/ 1000.00- 1173.20 \ 

\ 200.00 2 ) P 
( 1000.00 - 1100.00 1186.50 - 1100.00 \ . 

V 200.00 2 ) P 

( 1173.20 - 1000.00 1173.20 - 1223.00 \ 

V 200.00 2 

99.81 2 ) r 

V 200.00 2 99.81 2 / 

/ 1186.50- 1100.00 \ . 

( 1173.50- 1223.00 \ _ 

V 99.81 2 


V 99.81 2 / P 

0.866 0.500 ‘ 



- 0.499 - 0.867 




515.7 

-2306.6 

1709.9 


- 893.2 
1924.2 
-1031.1 


Step 4: Formulate the W matrix. The fact that distance and angle obser¬ 
vations have differing observational units and are combined in an 
adjustment is resolved by using relative weights that are based on obser¬ 
vational variances in accordance with Equation (10.6). This weighting 
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TABLE 16.1 Subscript Substitution 


Observation 

Subscript substitution 

Length RU 

R = U U=j 

Length US 

U= i, S =j 

Angle 9 X 

Q = b,R = i, U=f 

Angle 9 2 

R = b, U=i,S=f 

Angle 8 3 

U=b,S = i, T=f 


makes the observation equations consistent dimensionally. If weights are 
not used in traverse adjustments (i.e., equal weights are assumed), the 
least squares problem will generally either give unreliable results or result 
in a system of equations that has no solution. Since weights influence 
the correction size that each observation will receive, it is extremely 
important to use variances that correspond closely to the observational 
errors. The error propagation procedures discussed in Chapter 7 aid in 
the determination of the reasonable estimated errors for each observa¬ 
tion. Repeating Equation (10.6), the distance and angle weights for this 
problem are 


distances: w, = — and angles: 

Sj 


1 



(16.4) 


Again, the units of the weight matrix must match those of the J and K 
matrices. That is, the angular weights must be in the same units of measure 
(seconds) as the counterparts in the other two matrices. Based on the estimated 
errors in the observations, the W matrix, which is diagonal, is 


1 

0.05 2 


W = 


1 

0.08 2 


(zeros) 


30 2 


30 2 


[400.00 


W = 


156.2 


0.0011 


(zeros) 


30 2 

(zeros) 


(zeros) 


0.0011 


0.0011 
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Step 5: Solve the matrix system. This problem is iterative and was 
solved according to Equation (11.39) using the program MATRIX. 
The MATRIX data hie was created using the spreadsheet hie Chapter 
16.xls. The first iteration yielded the following corrections to the initial 
coordinates. 

dx u = -0.11 ft 
dy u = -0.01 ft 


Note that a second iteration produced zeros for dx u and dy u . The reader 
is encouraged to use the MATRIX or ADJUST program to duplicate these 
results. The ADJUST data hie Adjust file for Example 16-1. dat is shown in 
Figure 16.3. It has the format described in Section 14.7. 


Example 16.1 
2 3 0 4 5 
0 1000.00 800.00 
R 1000.00 1000.00 
S 1223.00 1186.50 
T 1400.00 1186.50 
U 1173.20 1100.00 
R D 200.00 0.05 
U S 100.00 0.08 
0 R U 240 00 00 30 
R U S 150 00 00 30 
U S T 240 01 00 30 

FIGURE 16.3 ADJUST data Hie for Example 16.1. 

Step 6: Compute the a posteriori adjustment statistics. Also from the program 
MATRIX, the residuals and reference standard deviation are 

=-0.11 ft v us = -0.12 ft v 6i =-49" 

v 02 = -17" v 6i = 6" S 0 = ±1.82 

A x 1 test was used as discussed in Section 4.10 to see if the a posteriori 
reference variance differed significantly from its a priori value of l 2 . 1 The test 


'Since weights are calculated using the formula: w> ; = o- 2 /ff 2 , using weights of 1 /<t? implies an a 
priori value of l 2 for the reference variance (See Chapter 10). 
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revealed that there was no statistically significant difference between the a 
posteriori value of 1.82 2 and it’s a priori value of l 2 at a 99% confidence 
level, and thus, the a priori value was used for the reference variance when 
computing the standard deviations of the coordinates. By applying Equation 
(13.24), the estimated errors in the adjusted coordinates are 

S Xu = 1.00V0.00053 = ±0.023 ft 
S yv = 1.00V0.000838 = ±0.029 ft 

If the x 1 test had been performed at a 0.05 level of significance, the test would 
have rejected the reference variance being equal to its a priori value. Thus, at 
a 95% confidence level, the a posteriori reference variance should have been 
used to compute the post-adjustment statistics. Many software packages sim¬ 
ply provide the values computed using the a posteriori value for the reference 
variance. If the computed a posteriori value of ± 1.82 had been used to compute 
the standard deviations in the coordinates, the resulting values of S x and S y 
would be ±0.042 ft and ±0.053 ft, respectively. Since most surveyors are only 
concerned about having reliable coordinate values, this discrepancy is of little 
consequence in everyday practice. 

Following are the results from the program ADJUST. 


Initial approximations for unknown stations 

* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * 


Station 

Northing 

Easting 


U 

1,100.00 

1,173.20 


Control Stations 



Station 

Easting 

Northing 


Q 

1,000.00 

800.00 


R 

1,000.00 

1,000.00 


S 

1,223.00 

1,186.50 


T 

1,400.00 

1,186.50 


Distance Observations 



Station 

Station 



Occupied 

Sighted 

Distance 

S 

R 

U 

200.00 

0.050 

U 

S 

100.00 

0.080 
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Angle Observations 


Station Station Station 

Backsighted Occupied Foresighted Angle S 


Q 

R 


U 

240° 00' 

00" 

30" 

R 

U 


s 

150° 00' 

00" 

30" 

U 

S 


T 

240° or 

00" 

30" 

First Iteration Matrices 







1 Dim: 5x2 


K Dim: 

5x1 

X Dim: 

2x1 


0.86602 0.50001 


0.00440 


-0.11 



-0.49894 -0.86664 


0.18873 


-0.01 



515.68471 -893.16591 


2.62001 






-2306.62893 

1924.25287 

249.36438 

1790.94422 

-1031.08696 

-191.98440 


W Dim: 5x5 


400.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

156.25000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00111 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00111 

0.00000 

0.00000 

0.00000 

0.00000 

0.00000 

0.00111 

N Dim: 2x2 



Qxx Dim: 

2x2 


10109.947301-7254.506002 
-7254.506002 6399.173533 

0.000530 

0.000601 

0.000601 

0.000838 

Final Iteration 

3 Dim: 5x2 

K Dim: 5x1 

X Dim: 2x1 

0.86591 0.50020 

0.10723 

0.0000 

-0.49972 -0.86619 

0.12203 

0.0000 

516.14929 -893.51028 

48.62499 


-2304.96717 1925.52297 

17.26820 


1788.81788 -1032.01269 

-5.89319 


N Dim: 2x2 

Qxx Dim: 2x2 



10093.552221- 

■7254.153057 

0.000532 

0.000602 

-7254.153057 

6407.367420 

0.000602 

0.000838 
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3 Qxx lit Dim: 5x5 


0.001130 

-0.001195 

-0.447052 

0.055151 

0.391901 

-0.001195 

0.001282 

0.510776 

-0.161934 

-0.348843 

-0.447052 

0.510776 

255.118765 

-235.593233 

-19.525532 

0.055151 

-0.161934 

-235.593233 

586.956593 

-351.363360 

0.391901 

-0.348843 

-19.525532 

-351.363360 

370.888892 


Adjusted stations 


Station Northing 

Easting 

S-N 

S-E 

U 1,099.99 

1,173.09 

0.053 

0.042 


Adjusted Distance Observations 


Station 

Station 





Occupied 

Sighted 

Distance 

V 

S 


R 

U 

199.89 

-0.11 

0.061 


U 

S 

99.88 

-0.12 

0.065 


it it it it it it it it it it it it it it it it it it it it it it it it 

* * * 




Adjusted Angl 

e Observations 




* it it it it it it it it it it it it 

it it it it it it it it it it it 

* * * 




Station 

Station 

Station 




Backsight 

Occupied 

Foresight 

Angl e 

V 

S 

Q 

R 

U 

239°59'11" 

-49" 

29.0" 

R 

U 

S 

149°59'43" 

-17" 

44. 1 " 

S 

S 

T 

240°01'06" 

6" 

35.0" 


-Reference Standard Deviation = ±1.82 

Iterations » 2 


16.5 MINIMUM AMOUNT OF CONTROL 

All adjustments require some form of control and failure to supply a 
sufficient amount will result in an indeterminate solution. A traverse requires 
a minimum of one control station to fix it in position and one line of known 
direction to fix it in angular orientation. When a traverse has the minimum 
amount of control, it is said to be minimally constrained. It is not possible to 
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adjust a traverse without this minimum. If minimal constraint is not available, 
necessary control values can be assumed and the computational process carried 
out in arbitrary space. This enables the observed data to be tested for blunders 
and errors. In Chapter 21, we discuss minimally constrained adjustments. 

A free network adjustment involves using a pseudo inverse to solve systems 
that have less than the minimum amount of control. This material is beyond 
the scope of this book. Readers interested in this subject should consult 
Bjerhammar (1973) or White (1987) in the bibliography at the end of the book. 


16.6 ADJUSTMENT OF NETWORKS 

With the introduction of the EDM instrument, and particularly the total 
station, the speed and reliability of making angle and distance observations 
have increased greatly. This has led to observational systems that do not 
conform to the basic systems of trilateration, triangulation, or traverse. For 
example, it is common to collect more than the minimum observations at 
a station during a horizontal control survey. This creates what is called a 
complex network, referred to more commonly as a network. The least squares 
solution of a network is similar to that of a traverse. That is, observation 
equations are written for each observation using the prototype equations given 
in Section 16.2. Coordinate corrections are found using Equation (11.39) and 
a posteriori error analysis is carried out. 

Example 16.2 A network survey was conducted for the project shown in 
Figure 16.4. Station Q has control coordinates of (1000.00, 1000.00) and 
the azimuth of line QR is 0°06 / 24.5" with an estimated error of ±0.001". 
The observations and their estimated errors are listed in Table 16.2. Adjust 
this survey by the method of least squares. 



FIGURE 16.4 Horizontal network. 

SOLUTION Using standard traverse coordinate computation methods, the 
initial approximations for station coordinates (x, y) were determined to be 


R: (1003.07, 2640.00) 


S': (2323.07, 2638.46) 


T: (2661.74, 1096.08) 
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TABLE 16.2 Data for Example 16.2 


Distance Observations 


Occupied, i 

Sighted, j 

Distance (ft) 

s (ft) 


Q 

R 

1640.016 

0.026 


R 

S 

1320.001 

0.024 


S 

T 

1579.123 

0.025 


T 

Q 

1664.524 

0.026 


Q 

s 

2105.962 

0.029 


R 

T 

2266.035 

0.030 


Angle Observations 




Backsight, b 

Instrument, 

i Foresight,/ 

Angle 

S(") 

R 

Q 

S 

38°48'50.7" 

4.0 

S 

Q 

T 

47°46T2.4" 

4.0 

T 

Q 

R 

273°24'56.5" 

4.4 

Q 

R 

S 

269°57'33.4" 

4.7 

R 

S 

T 

257°32'56.8" 

4.7 

S 

T 

Q 

279°04'31.2" 

4.5 

s 

R 

T 

42° 52' 51.0" 

4.3 

s 

R 

Q 

90°02'26.7" 

4.5 

Q 

S 

R 

51°08'45.0" 

4.3 

T 

s 

Q 

51°18T6.2" 

4.0 

Q 

T 

R 

46°15'02.0" 

4.0 

R 

T 

s 

34°40'05.7" 

4.0 


Azimuth Observations 



From, i 

To, j 

Azimuth 

sn 

Q 

R 

0°06'24.5" 

0.001 


Under each station heading in the observation columns of Table 16.2, a letter 
representing the appropriate prototype equation dx and dy coefficient appears. 
For example, for the first distance QR , station Q is substituted for i in prototype 
Equation (16.1) and station R replaces j. For the hi st angle, observed at (2 from 
R to S, station R takes on the subscript b, Q becomes i, and S is substituted 
for/in prototype Equation (16.2). 

Table 16.3 shows the structure of the coefficient matrix for this adjustment 
and indicates by subscripts where the nonzero values occur. In this table, the 
column headings are the elements of the unknown X matrix dx n dy r , dx s , dy s , 
dx„ and dy t . Note that since station Q is a control station, its corrections are 
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TABLE 16.3 Format for Coefficient Matrix J of Example 16.4 


Observations 



Unknowns 



dx r 

dy r 

dx s 

dy s 

dx t 

dy, 

QR 

j 

j 





RS 

i 

i 

j 

j 



ST 



i 

i 

j 

i 

TQ 





i 

i 

QS 



j 

j 



RT 

i 

i 



j 

j 

zRQS 

b 

b 

f 

f 



zSQT 



b 

b 

f 

f 

zTQR 

f 

f 



b 

b 

zQRS 

i 

i 

f 

f 



zRST 

b 

b 

i 

i 

f 

f 

zSTQ 



b 

b 

i 

i 

zSRT 

i 

i 

b 

b 

f 

f 

zSRQ 

i 

i 

b 

b 



zQSR 

f 

f 

i 

i 



zTSQ 



i 

i 

b 

b 

zQTR 

f 

f 



i 

i 

zRTS 

b 

b 

f 

f 

i 

i 

A Z QR 

j 

j 






set to zero and thus dx q and dy q are not included in the adjustment. Note also 
in this table that the elements that have been left blank are zeros. 

To fix the orientation of the network, the direction of course QR is included 
as an observation, but with a very small estimated error, ±0.001". The last row 
of Table 16.3 shows the inclusion of this constrained observation using pro¬ 
totype Equation (16.3). Since for azimuth QR only the foresight station, R , 
is an unknown, only coefficients for the foresight station j are included in the 
coefficient matrix. 

Following are the necessary matrices for the first iteration when doing the 
weighted least squares solution of the problem. Note that the numbers have 
been truncated to five decimal places for publication purposes only. Following 
these initial matrices, the results of the adjustment are listed, as determined with 
program ADJUST using the file Adjust file for Example 16-2.dat, which is on 
the companion website. Additionally, this problem is solved in the Mathcad 
file cl6.xmcd and the matrices for the problem are developed in the spreadsheet 
Chapter 16.xls. Readers are encouraged to explore these files. 
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0.00187 

1.00000 

0.00000 

0.00000 

0.00000 

-1.00000 

0.00117 

1.00000 

-0.00117 

0.00000 

0.00000 

0.00000 

-0.21447 

0.97673 

0.21447 

0.00000 

0.00000 

0.00000 

0.00000 

0.99833 

0.00000 

0.00000 

0.62825 

0.77801 

0.00000 

-0.73197 

0.68133 

0.00000 

0.00000 

0.73197 

-125.77078 

0.23544 

76.20105 

-61.53298 

0.00000 

0.00000 

0.00000 

-76.20105 

61.53298 

7.15291 

125.77078 

-0.23544 

0.00000 

0.00000 

-7.15291 

-125.58848 

156.49644 

-0.18230 

-156.26100 

0.00000 

-0.18230 

-156.26100 

127.76269 

184.27463 

-127.58038 

0.00000 

0.00000 

-127.58038 

-28.01362 

134.73329 

61.83602 

-89.63324 

0.18230 

156.26100 

-62.01833 

125.58848 

-156.49644 

0.18230 

156.26100 

0.00000 

0.18230 

156.26100 

-76.38335 

-94.72803 

0.00000 

0.00000 

0.00000 

-51.37934 

-89.54660 

127.58038 

62.01833 

66.62776 

0.00000 

0.00000 

-69.17123 

-62.01833 

-66.62776 

127.58038 

28.01362 

-65.56206 

125.77078 

-0.23544 

0.00000 

0.00000 

0.00000 


The weight matrix is 


1 

0.026 2 


1 

0.024 2 


1 

0.025 2 


1 

0.026 2 


1 

0.029 2 


1 

0.030 2 


1 

4.0 2 


1 

4.0 2 


4.4 Z 


1 

4.7 2 


1 

4.7 2 


1 

4.5 2 


1 

4.3 2 


1 

4.5 2 


1 

4.3 2 


1 

4.0 2 


1 

4.0 2 


(zeros) 


0.00000 

0.00000 

-0.97673 

0.05772 

0.00000 

-0.68133 

0.00000 

123.71223 

123.71223 

0.00000 

-28.01362 

-95.69861 

-66.62776 

0.00000 

0.00000 

28.01362 

57.08446 

38.61414 

0.00000 


(zeros) 


4.0 2 

I 

0.001 2 - 
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The K matrix is 


K = 


0.0031' 

-0.0099 

-0.0229 

-0.0007 

-0.0053 

-0.0196 

-0.0090 

-0.5988 

0.2077 

-2.3832 

1.4834 

-1.4080 

-1.0668 

2.4832 

-0.0742 

-3.4092 

-22.1423 

2.4502 

-0.3572 


Following is a summary of results from ADJUST. 


Number of Control Stations » 1 

Number of Unknown Stations » 3 

Number of Distance observations » 6 
Number of Angle observations » 12 
Number of Azimuth observations » 1 


Initial approximations for unknown stations 


Station 

X 

Y 

R 

1,003.06 

2,640.01 

S 

2,323.07 

2,638.47 

T 

2,661.75 

1,096.07 

Control 

Stations 


Station 

X 

Y 

Q 

1,000.00 

1,000.00 
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Distance Observations 


Station 

Station 




Occupied 

Sighted 

Distance 

S 


Q 

R 

1,640.016 

0.026 


R 

S 

1,320.001 

0.024 


S 

T 

1,579.123 

0.025 


T 

Q 

1,664.524 

0.026 


Q 

S 

2,105.962 

0.029 


R 

T 

2,266.035 

0.030 


* * * "it * * * * * * * * ■>' 

r * * * * * 




Angle Observations 

J. J. .1. .1. .1. .1. 4. .1. JU .I. .1. .1. 




Station 

Station 

Station 



Backsighted 

Occupied 

Foresighted 

Angl e 

S (") 

R 

Q 

S 

38° 48' 50.7" 

4.0 

S 

Q 

T 

47° 46' 12.4" 

4.0 

T 

Q 

R 

273° 24' 56.5" 

4.4 

Q 

R 

S 

269° 57' 33.4" 

4.7 

R 

S 

T 

257° 32' 56.8" 

4.7 

S 

T 

Q 

279° 04' 31.2" 

4.5 

S 

R 

T 

42° 52' 51.0" 

4.3 

S 

R 

Q 

90° 02' 26.7" 

4.5 

Q 

S 

R 

51° 08' 45.0" 

4.3 

T 

S 

Q 

51° 18' 16.2" 

4.0 

Q 

T 

R 

46° 15' 02.0" 

4.0 

R 

T 

S 

34° 40' 05.7" 

4.0 

Azimuth Observations 




V? * * * V? * * * * * * * V? * * * * * * * V? 




Station 

Station 




Occupied 

Sighted 

Azimuth 

S 


Q 

R 

0° 06' 24.5" 

0.0" 



Iteration: 1 

K MATRIX 


X MATRIX 


0.0031 

-0.002906 

0.0099 

-0.035262 

0.0229 

-0.021858 

0.0007 

0.004793 

0.0053 

0.003996 

0.0196 

-0.014381 
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0.0090 
0.5988 
0.2077 
2.3832 
1.4834 
1.4080 
1.0668 
2.4832 
0.0742 
3.4092 
22.1423 
2.4502 
0.3572 


Iteration: 2 

K MATRIX X MATRIX 


0.0384 

0.0176 

0.0155 

0.0039 

0.0087 

0.0104 

2.0763 

0.6962 

2.3725 

0.6444 

0.5048 

3.3233 

1.3435 

0.7444 

3.7319 

5.2271 

18.5154 

0.7387 

0.0000 


0.000000 

-0.000000 

- 0.000000 

0.000000 

- 0.000000 

0.000000 


INVERSE MATRIX 


0.00000000 

0.00000047 

0.00000003 

0.00000034 

0.00000005 

0.00000019 


0.00000047 

0.00025290 

0.00001780 

0.00018378 

0.00002767 

0.00010155 


0.00000003 

0.00001780 

0.00023696 

-0.00004687 

0.00006675 

-0.00008552 


0.00000034 

0.00018378 

-0.00004687 

0.00032490 

0.00010511 

0.00022492 


0.00000005 

0.00002767 

0.00006675 - 

0.00010511 

0.00027128 

0.00011190 


0.00000019 

0.00010155 

0.00008552 

0.00022492 

0.00011190 

0.00038959 
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Adjusted stations 


Station 

X 


Y 

Sx 

Sy 

R 

1,003.06 

2,639. 

.97 

0.000 

0.016 

S 

2,323.07 

2,638. 

.45 

0.015 

0.018 

T 

2,661.75 

1,096. 

.06 

0.016 

0.020 

Adjusted Distance Observations 




V? Vc Vc Vc V? Vc Vc * * * i 

'c Vc V? * * Vc V? * * * V? * * * * Vc * * 

Vc Vc 




Station 

Station 





Occupied 

Sighted Distance 


V 

S 

Q 

R 1,639.978 

-0. 

.0384 

0.0159 

R 

S 1,320.019 

0. 

.0176 

0.0154 

S 

T 1,579.138 

0. 

.0155 

0.0158 

T 

Q 1,664.528 

0. 

.0039 

0.0169 

Q 

S 2, 

105.953 

-0. 

.0087 

0.0156 

R 

T 2, 

266.045 

0. 

.0104 

0.0163 

J. JU J. JU A JU JU JU JU .1. JU JL A J. JU .1. 

Adjusted Angle Observations 





* Vc * * * * * * * Vc * 

V * * Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc 





Station 

Station Station 





Backsighted 

Occupied Foresighted 


Angle 

V 

S (") 

R 

Q S 

38° 48' 

52.8" 

2.08" 

1.75 

S 

Q T 

47° 46' 

13.1" 

0.70" 

1.95 

T 

Q R 

273° 24' 

54.1" 

-2.37" 

2.40 

Q 

R S 

269° 57' 

34.0" 

0.64" 

2.26 

R 

S T 

257° 32' 

57.3" 

0.50" 

2.50 

S 

T Q 

279° 04' 

34.5" 

3.32" 

2.33 

S 

R T 

42° 52' 

52.3" 

1.34" 

1.82 

S 

R Q 

90° 02' 

26.0" 

-0.74" 

2.26 

Q 

S R 

51° 08' 

41.3" 

-3.73" 

1.98 

T 

S Q 

51° 18' 

21.4" 

5.23" 

2.04 

Q 

T R 

46° 15' 

20.5" 

18.52" 

1.82 

R 

T S 

34° 40' 

05.0" 

-0.74" 

1.72 

V? * * * V? Vc * * V? * ■! 

k Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc 

Vc 





Adjusted Azimuth Observations 


Station 
Occupied 

Station 

Sighted 

Azimuth 

V 

S 

Q 

R 

0° 06' 24.5" 

0.00" 

0.00" 
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* ■it it * it * * * * it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it 

Adjustment Statistics 

* it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it it 

Iterations = 2 
Redundancies = 13 
Reference Variance =2.20 
Reference So = ±1.5 

Passed X 2 ; test at 99.0% significance level! 

X 2 ; lower value = 3.57 
X 2 ; upper value = 29.82 

The a priori value of 1 used in computations involving 
the reference variance 

Convergence! 


16.7 x 2 TEST: GOODNESS OF FIT 

At the completion of a least-squares adjustment, the significance of the com¬ 
puted reference variance, S 2 can be checked statistically. This check is often 
referred to as a goodness-of-fit test since the computation of S ' 2 is based on 
2jv 2 . That is, as the residuals become larger, so will the reference variance com¬ 
puted, and thus the model computed deviates more from the observed values. 
However, the size of the residuals is not the only contributing factor to the size 
of the reference variance in a weighted adjustment. The stochastic model also 
plays a role in the size of this value. Thus, when the / 2 test indicates that the 
null hypothesis should be rejected, it may be due to a blunder in the data or 
an incorrect decision by the operator in selecting the stochastic model for the 
adjustment. In Chapter 21, these matters are discussed in greater detail. For 
now, the reference variance of the adjustment of Example 16.2 will be checked. 

In Example 16.2, there are 13 degrees of freedom and the computed refer¬ 
ence variance, S 2 , is 2.2. In Chapter 10, it was shown that the a priori value for 
the reference variance was 1. A check can be made to compare the computed 
value for the reference variance against its a priori value using a two-tailed / 2 
test. For this adjustment, a significance level of 0.01 was selected. The pro¬ 
cedures for doing the test were outlined in Section 4.10, and the results for 
this example are shown in Table 16.4. Since a/2 is 0.005 and the adjustment 
had 13 redundant observations, the critical x\ ()05 13 value from the table is 
29.82. Similarly its lower-tailed value is 3.57. It can be seen that the computed 
X 1 value is less than the upper-tailed tabular value and is greater than the 
lower-tailed tabular value. Thus, the test fails to reject the null hypothesis, H 0 . 
As explained in Step 6 of Section 16.4, the a priori value of 1 for S ' 2 can and 
should be used when computing the standard deviations for the station coor¬ 
dinates and observations since the computed value for the reference variance 
is only an estimate of the a priori value. 
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TABLE 16.4 Two-Tailed x 2 Test on S 2 


H 0 : = 1 

H a : S 2 * 1 


Test statistic: 

2 vS 2 13(2.2) 

* = — = —— 
a 1 i 

Rejection region: 

28.6 = X 2 > JTo.005,13 
28.6 = * < *0.995,13 


28.6 

29.82 

3.565 


PROBLEMS 

Note: For problems below requiring least squares adjustment, if a computer 
program is not distinctly specified for use in the problem, it is expected that 
the least squares method will be solved using a spreadsheet and the program 
MATRIX, which is included on the book’s companion website. Partial answers 
to problems marked with an asterisk are given in Appendix H. 

16.1 Using the following control, adjust the data given for the Figure P16.1. 
The control station coordinates in units of feet are 

A: x = 944.79 * = 756.17 C: x = 5086.48 *= 1032.90 

Mkl: x = 1291.13 * = 467.65 Mk2: jc = 6123.89 *= 1037.11 


Distance Observations Angle Observations 


From 

To 

Length (ft) 

^ (ft) 

BS 

Occ 

FS 

Angle 

5 H 

A 

B 

2651.08 

±0.017 

MK1 

A 

B 

285°36'46" 

±5.6 

B 

C 

2312.46 

±0.017 

A 

B 

C 

246°40'29" 

±3.2 





B 

C 

MK2 

147°41'01" 

±3.8 


(a) What is the standard deviation of unit weight, S 0 1 
*(b) List the adjusted coordinates of station B and their standard 
deviations. 

(c) Tabulate the adjusted observations, their residuals, and then- 
standard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a * 2 test on the reference variance at a 0.05 level of 
significance. 
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\ 

\ 

\ 

\ 

\ 

\ 

\ 

\ 

A Mkl 

FIGURE P16.1 


--AMk2 


16.2 Adjust by the method of least squares the closed traverse in 
Figure PI6.2. The data are given below. 


Observed Angles 


Angle 

Value 

S(") 

XAB 

115° 39'54" 

±4.4 

BAC 

22°54 / 44" 

±4.3 

CBA 

131°51'28" 

±5.1 

ACB 

25°13 / 43" 

±4.5 

Control Stations 

Station 

V(m) 

V(m) 

X 

5581.734 

7751.476 

A 

6634.098 

6823.278 


Observed Distances 


Course 

Distance (m) 

S(m) 

AB 

772.021 

±0.015 

BC 

705.054 

±0.015 

CA 

1348.922 

±0.016 


Unknown Stations 

Station 

X (m) 

Y (m) 

B 

7345.173 

7123.938 

C 

7983.019 

6823.495 


*(a) What is the reference standard deviation, ,S 0 ? 

(b) List the adjusted coordinates of the unknown stations and then- 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 
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FIGURE P16.2 


(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a / 2 test on the reference variance at a 0.05 level of signif¬ 
icance. 

16.3 Adjust the network shown in Figure P16.3 by the method of least 
squares. The data are listed as follows: 


Control Station 


Station 

X(m) 

Y(m) 

A 

1776.596 

2162.848 


Distance Observations 

Course 

Distance (m) 

S (m) 

AB 

294.704 

0.0046 

BC 

97.013 

0.0045 

CD 

336.287 

0.0046 

DA 

113.071 

0.0045 

AC 

376.005 

0.0046 


Unknown Stations 


Station 

X(m) 

Y (m) 

B 

1777.144 

2457.553 

C 

1836.902 

2533.979 

D 

1883.089 

2200.879 


Angle Observations 

Angle 

Value 

S(") 

CAD 

61°07'01" 

6.6 

BAC 

9°07'15" 

4.0 

CBA 

142°05'01" 

7.6 

ACB 

28°47'41" 

7.3 

DCA 

17°07'27" 

3.9 

ADC 

101°45'39" 

6.7 


(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and then- 
standard deviations. 
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(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a / 2 test on the reference variance at a 0.05 level of 
significance. 

The observed azimuth of line AB is 0°06'20.5" ± 1.4". 

16.4 Perform a weighted least squares adjustment using the following dis¬ 
tance observations and the angle observations given in Problem 15.3. 


From 

To 

Distance (m) 

5 

R 

U 

1188.641 

±0.015 

S 

u 

923.222 

±0.015 

T 

u 

1295.967 

±0.015 


(a) What is the reference standard deviation, .S 0 ? 

*(b) List the adjusted coordinates of the unknown station and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their 
standard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a x~ test on the reference variance at a 0.05 level of signif¬ 
icance. 

16.5 Perform a weighted least squares adjustment using the following dis¬ 
tance observations and the angle observations given in Problem 15.6. 


Occupied 

Sighted 

Distance (ft) 

5 (ft) 

P 

U 

1596.91 

±0.016 

Q 

U 

1305.75 

±0.016 

R 

u 

1446.62 

±0.016 

S 

u 

1277.35 

±0.015 
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(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown station and then- 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a x~ test on the reference variance at a 0.05 level of sig¬ 
nificance. 

16.6 Perform a weighted least squares adjustment using the following dis¬ 
tance observations and the angle observations given in Problem 15.8. 


From 

To 

Distance (ft) 

S( ft) 

A 

B 

2925.44 

0.015 

B 

C 

2179.01 

0.014 

C 

D 

2991.34 

0.015 

A 

C 

2740.88 

0.015 

B 

D 

4455.26 

0.018 


(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown station and then- 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and then- 
standard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a / 2 test on the reference variance at a 0.05 level of 
significance. 

16.7 Using the program ADJUST, do a weighted least squares adjustment 
using the following distance observations and the angle observations 
given in Problem 15.9. 


From 

To 

Distance (m) 

*S(m) 

A 

B 

3111.287 

0.010 

B 

C 

2908.209 

0.010 

C 

D 

3158.771 

0.010 

D 

A 

3260.371 

0.011 

A 

C 

4608.981 

0.015 

B 

D 

4168.004 

0.013 
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(a) What is the reference standard deviation, ,S' 0 ? 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their 
standard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a x 2 test on the reference variance at a 0.05 level of 
significance. 

16.8 Repeat Problem 16.7 using the additional data in Problem 15.10. 

16.9 Using the program ADJUST, do a weighted least squares adjustment 

using the following distance observations and the angle observations 

given in Problem 15.11. 


From 

To 

Distance (ft) 

Si ft) 

From 

To 

Distance (ft) 

Si ft) 

A 

D 

785.93 

0.015 

D 

E 

629.83 

0.015 

A 

C 

680.19 

0.015 

D 

F 

647.82 

0.015 

B 

C 

791.97 

0.015 

E 

F 

500.52 

0.015 

B 

D 

582.87 

0.015 

E 

G 

911.95 

0.015 

C 

D 

470.77 

0.015 

E 

H 

1053.53 

0.015 

C 

E 

342.61 

0.015 

F 

G 

764.33 

0.015 

C 

F 

720.55 

0.015 

F 

H 

664.87 

0.015 


(a) What is the reference standard deviation, ,S 0 ? 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their 
standard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a x 2 test on the reference variance at a 0.05 level of 
significance. 

16.10 Using the Program ADJUST do a weighted least squares adjustment 
using the following distance observations and the angle observations 
given in Problem 15.14. 
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From 

To 

Distance (ft) 

5 (ft) 

From 

To 

Distance (ft) 

5 (ft) 

A 

E 

2377.65 

0.014 

C 

F 

1859.84 

0.013 

A 

B 

2042.50 

0.014 

F 

J 

2150.44 

0.014 

B 

E 

2249.55 

0.014 

I 

J 

1942.84 

0.014 

E 

H 

2071.74 

0.014 

J 

G 

1956.66 

0.014 

E 

I 

2185.06 

0.014 

J 

K 

1845.58 

0.013 

E 

F 

2112.41 

0.014 

G 

K 

2317.92 

0.014 

H 

I 

1957.96 

0.014 

F 

G 

1957.04 

0.014 

F 

I 

1868.89 

0.013 

C 

G 

1859.82 

0.013 

B 

F 

1942.92 

0.014 

D 

G 

2209.38 

0.014 

B 

C 

1668.81 

0.013 

C 

D 

2280.09 

0.014 


(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown station and then- 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) Perform a / 2 test on the reference variance at a 0.05 level of sig¬ 
nificance. 

16.11 Using the distances from Problems 14.3 and 14.4, and the following 
angles perform a weighted least squares adjustment. 


BS 

Occupied 

FS 

Angle 

so 

B 

A 

C 

59°59'58" 

±2.9 

C 

A 

D 

59° 59'56" 

±2.5 

C 

B 

D 

43°03 / 12" 

±2.3 

C 

B 

A 

79°06 / 29" 

±3.0 

D 

C 

A 

58°19'07" 

±2.4 

A 

C 

B 

40°53'38" 

±2.5 

A 

D 

B 

23°56'47" 

±2.2 

B 

D 

C 

37°44'05" 

±2.2 


(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 









338 ADJUSTMENT OF HORIZONTAL SURVEYS: TRAVERSES AND HORIZONTAL NETWORKS 

(c) Tabulate the adjusted observations, their residuals, and their 
standard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a / 2 test on the reference variance at a 0.05 level of 
significance. 

16.12 Using the distances from Problem 14.10 and the angles listed below do 
a weighted least squares adjustment. 


BS 

Occupied 

FS 

Angle 

S(") 

E 

A 

B 

89°32T0" 

±2.0 

A 

B 

E 

38°19'46" 

±2.0 

E 

B 

D 

54°04'30" 

±2.0 

E 

B 

C 

109°24'50" 

±2.1 

B 

C 

D 

73° 1F00" 

±2.1 

C 

D 

B 

51°28'34" 

±2.1 

B 

D 

E 

90°34'25" 

±2.1 

D 

E 

B 

35°21'06" 

±2.0 

B 

E 

A 

52°08T1" 

±2.0 


(a) What is the reference standard deviation, .S' 0 ? 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) List the inverted normal matrix used in the last iteration. 

(e) Perform a / 2 test on the reference variance at a 0.05 level of sig¬ 
nificance. 

16.13 Do a weighted least squares adjustment using the following. 


Control Stations Unknown Stations 


Station 

E( m) 

N (m) 

Station 

E( m) 

A(m) 

A 

834.133 

666.605 

B 

1608.340 

909.299 




C 

1624.576 

1566.347 




D 

536.804 

1622.029 




E 

1156.384 

1276.568 
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Distance Observations 


Course 

Distance (m) 

S (m) 

AB 

811.353 

±0.005 

BC 

657.246 

±0.005 

CD 

1089.197 

±0.006 

DA 

1000.609 

±0.005 

EA 

689.862 

±0.005 

EB 

582.365 

±0.005 

EC 

550.605 

±0.005 

ED 

709.380 

±0.005 


Azimuth Observation 

Course 

Value 

S 

AB 

72°35'43" 

2.3" 


Angle Observations 


Angle 

Value 

5(") 

DAE 

45°08'06" 

±2.4 

EAB 

44°44'51" 

±2.4 

ABE 

56° 30'13" 

±2.5 

EBC 

52°19'01" 

±2.6 

BCE 

56°49'46" 

±2.6 

ECD 

34°41'07" 

±2.5 

CDE 

26°12'46" 

±2.4 

EDA 

43°34'13" 

±2.4 

BEA 

78°45'04" 

±2.6 

CEB 

70° 51'07" 

±2.6 

DEC 

119°06'07" 

±2.6 

AED 

91°17'42" 

±2.5 


(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) Perform a / 2 test on the reference variance at a 0.05 level of sig¬ 
nificance. 

16.14 Using ADJUST, do a weighted least squares adjustment using the fol¬ 
lowing data. 


Control Stations 

Station 

A (ft) 

Y (ft) 

A 

51,020.44 

50,977.05 

D 

60,369.82 

54,974.24 


Unknown Stations 


Station 

A (ft) 

Y (ft) 

B 

55,949.19 

50,943.17 

C 

60,268.19 

51,383.54 

E 

54,814.39 

54,483.06 

F 

49,885.65 

54,533.87 
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Distance Observations 


Course 

Length (ft) 

^ (ft) 

AB 

4928.85 

±0.019 

BC 

4341.36 

±0.017 

CD 

3592.15 

±0.016 

DE 

5577.10 

±0.020 

EC 

6273.01 

±0.022 

EB 

3717.32 

±0.016 

EA 

5165.90 

±0.019 

EE 

4929.11 

±0.019 

FA 

3733.46 

±0.016 


Angle Observations 


Angle 

Value 

SO 

FAE 

64° 57'13" 

±i.i 

EAB 

43°08'06" 

±1.0 

ABE 

71°49'53" 

±1.1 

EBC 

101°57'08" 

±1.1 

BCE 

35°25'56" 

±1.0 

ECD 

62°00'38" 

±1.1 

CDE 

83°20'34" 

±1.1 

DEC 

34°39'45" 

±1.0 

CEB 

42° 3 6'54" 

±1.1 

BEA 

65°02'09" 

±1.1 

AEF 

43°19'54" 

±1.0 

EFA 

71°42'50" 

±1.1 


(a) What is the reference standard deviation, ,S' (I ? 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) Perform a / 2 test on the reference variance at a 0.05 level of sig¬ 
nificance. 

16.15 Repeat Problem 16.14 using the following additional data. 


Angle 

Value 

S’ 

BAF 

251°54 / 42" 

1.1" 

CBA 

186° 12'54" 

1.1" 

DCB 

262°33'26" 

1.1" 

EDC 

276°40'27" 

1.1" 

FED 

174°21'26" 

1.0" 

AFE 

288°17'07" 

1.1" 


16.16 Using ADJUST, do a weighted least squares adjustment using the fol¬ 
lowing data. 

(a) What is the reference standard deviation, .S' 0 ? 

(b) List the adjusted coordinates of the unknown stations and their 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) Perform a / 2 test on the reference variance at a 0.05 level of sig¬ 
nificance. 
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16.17 Using ADJUST, do a weighted least squares adjustment using the data 
from Problem 16.16 and the following additional data. 


Control Stations Unknown Stations 


Station 

X(m) 

Y (m) 

Station 

A(m) 

Y (m) 

100 

51,308.376 

55,177.491 

1 

52,578.672 

54,974.244 

101 

56,931.550 

51,383.542 

2 

54,255.461 

54,872.620 

102 

60,302.066 

57,836.642 

3 

56,643.616 

54,804.871 




4 

58,083.284 

55,804.170 




5 

59,319.705 

56,972.841 




6 

56,812.989 

53,128.081 

Distance Observations 


Angle Observations 


Course 

Length (m) 

S ( m ) 

Angle 

Value 

S(") 

100-1 

1286.464 

+0.011 

100-1-2 

174°22'42" 

±2.2 

1-2 

1679.859 

+0.011 

1-2-3 

178°09'25" 

±2.1 

2-3 

2389.108 

+0.012 

2-3-4 

143°36'34" 

±2.1 

3-4 

1752.497 

+0.011 

4-3-6 

118° 59'52" 

±2.1 

4-5 

1701.349 

+0.011 

6-3-2 

97°23'34" 

±2.1 

5-102 

1308.130 

+0.011 

3-4-5 

171°22 / 43" 

±2.1 

3-6 

1685.342 

+0.011 

4-5-102 

182°03 / 40" 

±2.2 

6-101 

1748.563 

±0.011 

3-6-101 

181°52'48" 

±2.1 


(a) What is the reference standard deviation, S 0 1 

(b) List the adjusted coordinates of the unknown stations and then- 
standard deviations. 

(c) Tabulate the adjusted observations, their residuals, and their stan¬ 
dard deviations. 

(d) Perform a / 2 test on the reference variance at a 0.05 level of sig¬ 
nificance. 

Angle Observations 


Angle 

Value 

S(”) 

2-1-100 

185°37'23" 

±2.2 

3-2-1 

181°50'36" 

±2.1 

5^4-3 

188°37'13" 

±2.1 

102-5-4 

177°56'20" 

±2.2 

101-6-3 

178°07'10" 

±2.1 


16.18 Perform an F test on the reference variances from Problem 16.16 and 
16.17 at a 0.05 level of significance. 
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PROGRAMMING PROBLEMS 

16.19 Write a computational program that reads a file of station coordinates 
and observations and then 

(a) Writes the data to a hie in a formatted fashion. 

(b) Computes the J, K , and W matrices. 

(c) Writes the matrices to a hie that is compatible with the MATRIX 
program. 

(d) Demonstrate this program with Problem 16.17. 

16.20 Write a program that reads a hie containing the ./, K, and W matrices 
and then 

(a) Writes these matrices in a formatted fashion. 

(b) Performs one iteration in Problem 16.17. 

(c) Writes the matrices used to compute the solution, and tabulates the 
corrections to the station coordinates in a formatted fashion. 

16.21 Write a program that reads a hie of station coordinates and observa¬ 
tions and then 

(a) Writes the data to a hie in a formatted fashion. 

(b) Computes the J, K , and W matrices. 

(c) Performs a weighted least squares adjustment of Problem 16.17. 

(d) Writes the matrices used in computations in a formatted fashion 
to a hie. 

(e) Computes the hnal adjusted station coordinates, their estimated 
errors, the adjusted observations, their residuals, and their 
estimated errors, and writes them to a hie in a formatted fashion. 

16.22 Develop a computational program that creates the coefficient, weight, 
and constant matrices for a network. Write the matrices to a hie in 
a format usable by the MATRIX program supplied with this book. 
Demonstrate its use with Problem 16.17. 


CHAPTER 17 


ADJUSTMENT OF GNSS NETWORKS 


17.1 INTRODUCTION 

For the past seven decades, NASA and the US military have been engaged 
in a space research program to develop a precise positioning and navigation 
system. The first-generation system, called TRANSIT , used six satellites 
and was based on the doppler principle. TRANSIT was made available for 
commercial use in 1967, and shortly thereafter its use in surveying began. 
The establishment of a worldwide network of control stations was among its 
earliest and most valuable applications. Point positioning using TRANSIT 
required very lengthy observing sessions, and its accuracy was at the 1 m 
level. Thus, in surveying it was suitable only for control work on networks 
consisting of widely spaced points. It was not satisfactory for everyday 
surveying applications such as traversing or engineering layout. 

Encouraged by the success of TRANSIT, a new research program was 
developed that ultimately led to the creation of the Navigation Satellite 
Tracking and Ranging (NAVSTAR) Global Positioning System (GPS). This 
second-generation positioning and navigation system utilizes a nominal 
constellation of 24 orbiting satellites. The accuracy of GPS was a substantial 
improvement over that of the TRANSIT system, and the disadvantage of 
lengthy observing sessions was also eliminated. Although developed for 
military applications, civilians, including surveyors, also found uses for the 
GPS system. 
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Since its introduction, GPS has been used extensively. It has been found 
to be reliable, efficient, and capable of yielding extremely high accuracies. 
GPS observations can be taken day or night and in any weather conditions. 
A significant advantage of GPS is that visibility between surveyed points is 
not necessary. Thus, the time-consuming process of clearing lines of sight 
is avoided. Although most of the early applications of GPS were in control 
work, improvements have now made the system convenient and practical for 
use in virtually every type of survey including property surveys, topographic 
mapping, and construction staking. 

Today, several countries have or are in the process of developing satellite 
positioning systems similar to GPS. These combined systems are now known 
as global navigation satellite systems (GNSSs). In keeping with these changes, 
this book has adopted GNSS in reference to all of these satellite-positioning 
systems. 

This chapter provides a brief introduction to GNSS surveying. We explain 
the basic observations involved in the system, discuss errors in those obser¬ 
vations, describe the nature of the adjustments needed to account for those 
errors, and give the procedures for making adjustments of networks surveyed 
using GNSS. An example problem is given to demonstrate the procedures. 

17.2 GNSS OBSERVATIONS 

Fundamentally, global navigation satellite systems operate by observing 
distances from receivers located on ground stations of unknown locations to 
orbiting GNSS satellites whose positions are precisely known. Thus, conceptu¬ 
ally, GNSS surveying is similar to conventional resection, in that distances are 
observed with an EDM instrument from an unknown station to several con¬ 
trol points. (The conventional resection procedure was discussed in Chapter 15 
and illustrated in Example 15.2.) Of course, there are some major differences 
between GNSS position determination and conventional resection. Among 
them is the process of observing distances and the fact that the control stations 
used in GNSS work are satellites, which removes the need for intervisibility 
between stations. 

Distances are determined in GNSS surveying by taking observations on 
these transmitted satellite signals. Two different observational procedures are 
used: positioning by pseudoranging, and positioning by carrier phase-shift 
observations. Pseudoranging involves determining distances (ranges) between 
satellites and receivers by observing precisely the time it takes transmitted 
signals to travel from satellites to ground receivers. With the velocity and 
travel times of the signals known, the pseudoranges can be computed. Finally, 
based on these ranges, the positions of the ground stations can be calculated. 
Because pseudoranging is based on observing pseudorandom noise (PRN) 
codes, this GPS observation technique is also often referred to as the code 
measurement procedure. 
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In the carrier phase-shift procedure, the quantities observed are phase 
changes that occur as a result of the carrier wave traveling from the satellites 
to the receivers. The principle is similar to the phase-shift method employed 
by electronic distance-measuring instruments. However, a major difference is 
that the satellites are moving, and the signals are not returned to the trans¬ 
mitters for “true” phase-shift measurements. Instead, the phase shifts must 
be observed at the receivers. But to make true phase-shift observations, the 
clocks in the satellites and receivers would have to be perfectly synchronized, 
which, of course, cannot be achieved. To overcome this timing problem and to 
eliminate other errors in the system, differencing techniques (taking differences 
between phase observations) are used. Various differencing procedures can 
be applied. Single differencing is achieved by simultaneously observing two 
satellites with one receiver. Single differencing eliminates satellite clock biases. 
Double differencing (subtracting the results of single differences from two 
receivers) eliminates receiver clock biases and other systematic errors. 

Another problem in making carrier-phase observations is that only the 
phase shift of the last cycle of the carrier wave is observed, and the number 
of full cycles in the travel distance is unknown. (Recall in EDM work that 
this problem was overcome by transmitting longer wavelengths and observing 
their phase shifts.) Again, because the satellites are moving, this cannot be 
done in GNSS work. However, by extending the differencing technique to 
what is called triple differencing, this ambiguity in the number of cycles cancels 
out of the solution. Triple differencing consists of differencing the results of 
two double differences, and thus involves making observations at two different 
times to two satellites from two stations. 

Rather than performing triple differencing, a more common technique used 
in today’s software to determine ambiguities is to develop probable ranges 
for each of the range ambiguities. These ranges are analyzed using differing 
combinations from least squares adjustments. The final objective being the 
determination of the most probable combination of ranges that provides the 
most probable solution for the position of the receiver. 

In practice, when surveys are done by observing carrier phases, four or more 
satellites are observed simultaneously using two or more receivers located on 
ground stations. Also, the observations are repeated many times. This produces 
a very large number of redundant observations, from which many difference 
combinations can be computed. 

Of the two GNSS observing procedures, pseudoranging yields a somewhat 
lower order of accuracy, but it is preferred for navigation use because it gives 
instantaneous point positions of satisfactory accuracy. The carrier-phase 
technique produces a higher order of accuracy and is therefore the choice for 
high-precision surveying applications. Adjustment of carrier-phase GNSS 
observations is the subject of this chapter. 

The differencing techniques used in carrier-phase observations, described 
briefly above, do not yield positions directly for the points occupied by 
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receivers. Rather, baselines (vector distances between stations) are determined. 
These baselines are computed in terms of their coordinate difference com¬ 
ponents AX, AY, and AZ. These coordinate differences are reported in 
the reference three-dimensional rectangular coordinate system described 
in Section 17.4. 

To use the GNSS carrier-phase procedure in surveying, at least two receivers 
located on separate stations must be operated simultaneously. For example, 
assume that two stations A and B were occupied for an observing session, 
that station A is a control point, and that station B is a point of unknown 
position. The session would yield coordinate differences AX ab , AY ab , and 
AZ AB between stations A and B. The X, Y, Z coordinates of station B can 
then be obtained by adding the baseline components to the coordinates 
of A, as 

X B = X A + AX ab 

Y b = Y a + AY ab (17.1) 

= Z A + AZ ab 

Because carrier-phase observations do not yield point positions directly, 
but rather give baseline components, this method of GNSS surveying is 
referred to as relative positioning. In practice, often more than two receivers 
are used simultaneously in relative positioning, which enables more than 
one baseline to be determined during each observing session. Also, after the 
first observing session, additional points are interconnected in the survey by 
moving the receivers to other nearby stations. In this procedure, at least one 
receiver is left on one of the previously occupied stations. By employing this 
technique, a network of interconnected points can be created. Figure 17.1 
illustrates an example of a GNSS network. In this figure, stations A and B are 
control stations, and stations C, D, E , and F are points of unknown positions. 
Creation of such networks is a common procedure employed in GPS relative 
positioning work. 



FIGURE 17.1 GPS survey network. 
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17.3 GNSS ERRORS AND THE NEED FOR ADJUSTMENT 

As in all types of surveying observations, GNSS observations contain 
errors. The principal sources of these errors are (1) orbital errors in the 
satellite, (2) signal transmission timing errors due to atmospheric conditions, 
(3) receiver errors, (4) multipath errors (signals being reflected so that they 
travel indirect routes from satellite to receiver), and (5) miscentering errors of 
the receiver antenna over the ground station, and in height measuring errors 
above the station. To account for these and other errors, and to increase the 
precisions of point position, GNSS observations are very carefully made 
according to strict specifications, and redundant observations are taken. 
The fact that errors are present in the observations makes it necessary to 
analyze the observations for acceptance or rejection. Also, because redundant 
observations have been made, they must be adjusted so that all observed 
values are consistent. 

In GNSS surveying work where the observations are made using carrier 
phases, there are two stages where least squares adjustment is applied typi¬ 
cally. The first is in processing the redundant carrier phase-shift observations 
to obtain the adjusted baseline components (AX, AY, AZ), and the second is 
in adjusting networks of stations wherein the baseline components have been 
observed. The latter adjustment is discussed in more detail later in the chapter. 


17.4 REFERENCE COORDINATE SYSTEMS 
FOR GNSS OBSERVATIONS 

In GNSS surveys, three different reference coordinate systems are involved. 
First, the satellite positions at the instants of their observation are given in 
a space-related X s , Y v Z s three-dimensional rectangular coordinate system. 
This coordinate system is illustrated in Figure 17.2. In the figure, the elliptical 
orbit of a satellite is shown. It has one of its two foci at G, the Earth’s center 
of gravity. Two points, perigee (point where the satellite is closest to G) and 
apogee (point where the satellite is farthest from G), define the line of apsides. 
This line, which also passes through the two foci, is the X s axis of the satellite 
reference coordinate system. The origin of the system is at G, the Y s axis is in 
the mean orbital plane, and Z s is perpendicular to the X s — Y s plane. Since the 
instantaneous position of the satellites is used in computations, values of Z s 
are assumed to be zero. For each specific instant of time that a given satellite is 
observed, its coordinates are calculated in its unique X s , Y s , Z s system. 

In processing GNSS observations, all X s , Y s , Z s coordinates that 
were computed for satellite observations are converted to a common 
Earth-related X e , Y e , Z e three-dimensional geocentric coordinate system. 
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This Earth-centered, Earth-fixed coordinate system, illustrated in Figure 17.3, 
is also commonly called the terrestrial geocentric coordinate system, or simply 
the geocentric system. It is in this system that the baseline components are 
computed based on the differencing of observed carrier-phase observations. 
The origin of this coordinate system is at the Earth’s gravitational center. The 
Z e axis coincides with the Earth’s Conventional Terrestrial Pole (CTP) axis, the 
X e - Y e plane is perpendicular to the Z e axis, and the X e axis passes through the 
Greenwich Meridian. To convert coordinates from the space related (X s , Y s , 
Z s ) system to the Earth-centered, Earth-related ( X e , Y e , Z e ) geocentric system, 
six parameters are needed. These are (a) the inclination angle i (the angle 
between the orbital plane and the Earth’s equatorial plane); (b) the argument 
of perigee a> (the angle observed in the orbital plane between the equator 
and the line of apsides); (c) right ascension of the ascending node Q (the angle 
observed in the plane of the Earth’s equator from the vernal equinox to the line 
of intersection between the orbital and equatorial planes); (d) the Greenwich 
hour angle of the vernal equinox y (the angle observed in the equatorial plane 
from the Greenwich meridian to the vernal equinox); (e) the semimajor axis of 
the orbital ellipse, a; and (f) the eccentricity, e, of the orbital ellipse. The first 
four parameters are illustrated in Figure 17.3. For any satellite at any instant of 
time, these four parameters are available. Software provided by GNSS equip¬ 
ment manufacturers computes the X s , Y s , Z s coordinates of satellites at the 
instance of observation and transforms these coordinates into the X e , Y e , Z e 
geocentric coordinate system used for computing the baseline components. 
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Z 



FIGURE 17.3 Earth-related, three-dimensional coordinate system used in GPS 
carrier-phase differencing computations. 


In order for the results of the baseline computations to be useful to local 
surveyors, the X e , Y e , Z e coordinates must be converted to geodetic coordinates 
of latitude, longitude, and height. The geodetic coordinate system is illustrated 
in Figure 17.4, where the parameters are symbolized by 4>, A, and h, respectively. 
Geodetic coordinates are referenced to the World Geodetic System of 1984, 
which employs the WGS84 ellipsoid and is defined by the ground coordinates 
of the tracking stations. The center of this ellipsoid is oriented at the Earth’s 
gravitational center. Its origin varies from the origin of the NAD 83 datum by 
1.5 m. The differences between the two reference frames will be discussed in 
Chapter 24. From latitude and longitude, state plane coordinates, which are 
more convenient for use by local surveyors, can be computed. 

It is important to note that geodetic heights are not orthometric heights 
(elevations referred to the geoid). To convert geodetic heights to orthometric 
heights, the geoid heights (vertical distances between the ellipsoid and geoid) 
must be subtracted from geodetic heights. That is, 


h-H + N 
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FIGURE 17.4 Geodetic coordinates (with the Earth-centered, Earth-fixed coordi¬ 
nates X p , Y p , and Z P geocentric coordinate system superimposed). 


where h is the geodetic height of the point, H is the orthometric height (eleva¬ 
tion) of the point, and N is the geoid height (separation between the geoid and 
ellipsoid) below the point. 


17.5 CONVERTING BETWEEN THE TERRESTRIAL AND GEODETIC 
COORDINATE SYSTEMS 

GNSS networks must include at least one control point, but more are 
preferable. The geodetic coordinates of these control points will normally 
be given from a previous GNSS survey or Continuously Operating Reference 
Stations (CORSs). Prior to processing carrier-phase observations to obtain 
adjusted baselines for a network, the coordinates of the control stations in the 
network must be converted from their geodetic values into the Earth-centered, 
Earth-related X e , Y e , Z e geocentric system. The equations for making these 
conversions are 


X = (TV + h) cos($) cos(d) 

(17.2) 

Y - (N + h) cos(0) sin(A) 

(17.3) 

Z = [(./V( l - e 2 ) + h] sin (cp) 

(17.4) 


In the equations above, h is the geodetic height of the point; f the geodetic 
latitude of the point; and A the geodetic longitude of the point. Also, e is 
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eccentricity for the ellipsoid, which is computed as 


CN 

1 

cT 

II 

(17.5a) 

_ a 2 -b 2 

(17.5b) 


where /'is the flattening factor of the ellipsoid; a and b are the semimajor 
and semiminor axes, respectively, of the ellipsoid; 1 and N is the normal to the 
ellipsoid at the point, which is computed from 

N= a - (17.6) 

yj 1 — e 2 sin 2 / 

Note that the normal at a point, N, in Equations (17.2) through (17.6) should 
not be confused with the geoid height mentioned previously. 

Example 17.1 Control stations A and B of the GNSS network of Figure 17.1 
have the following NAD 83 geodetic coordinates. 

(p A = 43°15 , 46.2890" A a = -89°59'42.1640" h A = 1382.618 m 
cp B = 43°23'46.3626" A B = -89°54'00.7570" h B = 1235.457 m 

Compute their X e , Y e , Z e geocentric coordinates. 

SOLUTION For station A: By Equation (17.5a), 

e 2 = - - - ( --- V = 0.006694379990 

298.257223563 V 298.257223563 / 

By Equation (17.6), 

N = 6,378,137 = 6,388,188.252 m 

Vl -e2sin 2 43 o 15'46.2890" 

By Equation (17.2), 

X A = (6,388,188.252 + 1382.618) cos(43°15'46.2890")cos(-89°59 / 42.1640") 
= 402.3509 m 


*The WGS84 ellipsoid is used where a, b , and/values are 6,378,137.0 m, 6,356,752.3142 m, and 
1/298.257223563, respectively. 
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By Equation (17.3), 

Y A = (6,388,188.252 + 1382.618) cos(43°15'46.2890") sin(-89°59'42.1640") 
= -4,652,995.3011 m 

By Equation (17.4), 

= [6,388,188.252(1 - e 2 ) + 1382.618] sin(43° 15'46.2890") 

= 4,349,760.7775 m 

For station B: Following the same procedure as above, the geocentric coor¬ 
dinates for station B are 

X B = 8086.0318 m Y B — —4,642,712.8474 m Z B = 4,360,439.0833 m 

After completing the network adjustment, it is necessary to convert all X e , 
Y e , Y e geocentric coordinates to their geodetic values for use by local surveyors. 
This conversion process follows these steps (refer to Figure 17.4): 

Step 1: Determine the longitude, A, from 



(17.7) 


Step 2: Compute D from 


D = \]X- + Y 1 


(17.8) 


Step 3: Calculate an approximate latitude value 0 O from 



(17.9) 


Step 4: Compute an approximate ellipsoid normal value N 0 from 


a 


(17.10) 



Step 5: Calculate an improved value for latitude (p 0 from 



(17.11) 
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Step 6: Use the value of cp 0 computed in Step 5, and return to Step 4. Iterate 
Steps 4 and 5 until there is negligible change in cp 0 . Using the values from 
the last iteration for N 0 and </> 0 , the value for h is now computed 2 as 


h = 


D 

COS (f ) 0 


-N 0 


(17.12) 


Example 17.2 Assume that the final adjusted coordinates for station C of the 
network of Figure 17.4 were 

U c = 12,046.5808 m, Y c = -4,649,394.0826 m, Z c = 4,353,160.0634 m 
Compute the NAD 83 geodetic coordinates for station C. 


SOLUTION By Equation (17.7), 


X — tan 


A ;?IT'Z 26 ) = - 89°51'05.5691' 
12,046.5808 ) 


By Equation (17.8), 

D = V( 12,046.5808) 2 + (-4,649,394.0826) 2 = 4,649,409.6889 m 


Using Equation (17.9), the initial value for cp 0 is 
_! / 4,353,160.0634 \ 


0n = tan . 

' D{ l-e 2 ) 

The first iteration for N 0 and cp 0 is 

6,378,137.0 


■ 


JV 0 = 


= 43° 18 26.2228 


= 6,388,204.8545 m 


1 -e 2 sin 2 43°18 / 26.22280" 

The next iteration produced the final values as 

N 0 = 6,388,204.8421 0 O = 43°18 / 26.1030" 


Using Equation (17.12), the elevation of the station C is 

h =-^-- - 6,388,204.8421 = 1103.101 m 

cos43°18 26.1030 

A computer program included with the software package ADJUST, which is on 
the companion website for this book, will make these coordinate conversions; 
both from geodetic to geocentric and from geocentric to geodetic. 


2 Equation (17.12) is numerically unstable for values of (j> greater than 45°. For values of (j> greater 
than 45°, use the equation h = Z/ sin $ 0 - N 0 ( I — e 2 ). 
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17.6 APPLICATION OF LEAST SQUARES 
IN PROCESSING GNSS DATA 

As stated previously, a least squares adjustment is used at two different stages 
in processing GNSS carrier phase-shift observations. First, it is applied in the 
adjustment that yields baseline components between stations from the redun¬ 
dant carrier phase observations. Recall that in this procedure, differencing 
techniques are employed to compensate for errors in the system and to resolve 
the cycle ambiguities. In the solution, observation equations are written that 
contain the differences in coordinates between stations as parameters. The 
reference coordinate system for this adjustment is the X e , Y e , Z e geocentric 
system. A highly redundant system of equations is obtained because, as 
described earlier, a minimum of four (and often more) satellites are simulta¬ 
neously tracked using at least two (and often more) receivers. Furthermore, 
many repeat observations are taken. This system of equations is solved by least 
squares to obtain the most probable AX, AT, AZ components of the baseline 
vectors. The development of these observation equations is beyond the scope of 
this book, and thus their solution by least squares is also not covered herein. 3 

Software furnished by manufacturers of GNSS receivers will process 
observed phase changes to form the differencing observation equations, 
perform the least squares adjustment, and output the adjusted baseline 
vector components. The software will also output the covariance matrix, 
which expresses the correlation between the AX, AT, AZ components of each 
baseline. The software is proprietary and thus cannot be included herein. 

The second stage where least-squares adjustments are employed in pro¬ 
cessing GNSS observations is in adjusting baseline vector components in 
networks. This adjustment is made after the least squares adjustment of the 
carrier-phase observations is completed. It is also done in the X e , Y e , Z e 
geocentric coordinate system. In network adjustments, the goal is to make 
all X coordinates (and all X-coordinate differences) consistent throughout 
the figure. The same objective applies for all Y coordinates and for all Z 
coordinates. As an example, consider the GPS network shown in Figure 17.1. 
It consists of two control stations and four stations whose coordinates are to 
be determined. A summary of the baseline observations obtained from the 
least squares adjustment of carrier phase-shift observations for this figure 
is given in Table 17.1. The covariance matrix elements that are listed also in 
Table 17.1 are used for weighting the observations. These will be discussed in 
Section 17.8, and for the moment they can be ignored. 

A network adjustment of Figure 17.1 should yield adjusted X coordi¬ 
nates for the stations (and adjusted coordinate differences between stations) 
that are all mutually consistent. Specifically for this network, the adjusted 

’Readers interested in studying these observation equations should consult GNSS , by Hoffman- 
Wellenhof et al., or GPS Satellite Surveying by A. Leick. Complete references for these publica¬ 
tions are given in the Bibliography at the end of the book. 
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Fixed baseline used only for checking, but not included in adjustment. 
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X coordinate of station C should be obtained by adding AX ac to the 
X coordinate of station A ; and the same value should be obtained by adding 
AX BC to the X coordinate of station B, or by adding AX DC to the X coordinate 
of station D, and so on. Equivalent conditions exist for the Y and Z coordi¬ 
nates. Note that these conditions do not exist for the data of Table 17.1, which 
contains the unadjusted baseline observations. The procedure of adjusting 
GNSS networks is described in detail in Section 17.8, and an example is given. 


17.7 NETWORK PREADJUSTMENT DATA ANALYSIS 

Prior to adjusting GNSS networks, a series of procedures should be followed 
to analyze the data for internal consistency and to eliminate possible blunders. 
No control points are needed for these analyses. Depending on the actual 
observations taken and the network geometry, these procedures may consist 
of analyzing (1) differences between fixed and observed baseline compo¬ 
nents, (2) differences between repeated observations of the same baseline 
components, and (3) loop closures. After making these analyses, a minimally 
constrained adjustment is usually performed that will help isolate any blunders 
that may have escaped the first set of analyses. Procedures for making these 
analyses are described in the following subsections. 


17.7.1 Analysis of Fixed Baseline Measurements 

GNSS job specifications often require that baseline observations be taken 
between fixed control stations. The benefit of making these observations is to 
verify the accuracy of both the GNSS observational system and the control 
being held fixed. Obviously, smaller the discrepancies between observed and 
known baseline lengths mean more accurate observations. If the discrepancies 
are too large to be tolerated, the conditions causing them must be investigated 
before proceeding further. Note that in the data of Table 17.1, one fixed 
baseline (between control points A and B ) was observed. Table 17.2 gives 
the data for comparing the observed and fixed baseline components. The 
observed values are listed in column (2), and the fixed components are given 
in column (3). To compute the fixed values, X e , Y e , Z e geocentric coordinates 
of the two control stations are first determined from their geodetic coordinates 
according to procedures discussed in Section 17.5. Then the AX, AY, AZ 
differences between the X e , Y e , Z e coordinates for the two control stations are 
determined. Differences (in meters) between the observed and fixed baseline 
components are given in column (4). Finally the differences, expressed in parts 
per million (ppm), are listed in column (5). These ppm values are obtained 
by dividing column (4) differences by their corresponding total baseline 
lengths and multiplying by 1,000,000. A determination of the acceptability 
of the computed ppm can be evaluated based on published standards such 
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TABLE 17.2 Comparisons of Observed and Fixed Baseline Components 


(1) 

Component 

(2) 

Observed (m) 

(3) 

Fixed (m) 

(4) 

Difference (m) 

(5) 

PPM" 

AX 

7,683.6883 

7,683.6809 

0.0074 

0.44 

AY 

10,282.4550 

10,282.4537 

0.0013 

0.08 

A Z 

10,678.3008 

10,678.3058 

0.0050 

0.30 


“The total baseline length used in computing these ppm values was 16,697 m, which was derived 
from the square root of the sum of the squares of AX, AT, and AZ values. 


as the Federal Geodetic Control Subcommittee’s Geometric Geodetic Accuracy 
Standards and Specifications for Using GPS Relative Positioning Techniques. 

When the standards are inappropriate for the survey method being per¬ 
formed, the baselines can also be compared against the estimated error in the 
line based on manufacturer’s specifications for the particular survey method 
used. Since each receiver in a baseline adds in an additional three-dimensional 
setup error a s , the error in any observed baseline can be estimated as 

G baseline = 2 °s + Cl 2 + (L -ppm) 2 (17.13) 

where a is the specified constant error for an observed baseline and L is the 
length of the baseline observed. For example, the typical specified accuracy 
for a baseline determined using static surveying procedures is 5 mm + 1 ppm, 
where a is 5 mm and 1 the ppm. Baseline AB is approximately 16,697 m in 
length. Based on the previously stated accuracies and assuming setup errors of 
0.0015 m for each receiver. Using Equation (17.13), the estimated error in the 
baseline is 


& baseline = -^2(0.0015)2 + 0.005 2 + ( [ |^ () • l) = ±0.0176 m 

Since the baseline is determined from more than 30 individual epochs of data 
with multiple satellite observations typically, the normal distribution multiplier 
can be used to raise this uncertainty to an appropriate percent probability. 
For example, at 95% the estimated error in the baseline could be as much as 
1.96(0.0176), which equals ±0.034 m. Since the actual misclosure b etween the 
observed and fixed baseline is only Vo.0074 2 + 0.0013 2 + 0.0050 2 = 0.009 m, 
it is well within the 95% range of the estimated misclosure. 


17.7.2 Analysis of Repeat Baseline 

Another procedure employed in evaluating the consistency of the observed data 
and in weeding out blunders is to make repeat observations of certain baselines. 
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TABLE 17.3 Comparisons of Repeat Baseline Measurements 


Component 

First Observation 

Second Observation 

Difference (m) 

PPM 

AX af 

1116.4577 

-1116.4523 

0.0054 

0.84 

A Y AF 

4596.1553 

-4596.1610 

0.0057 

0.88 

kZ AF 

4355.9141 

-4355.9062 

0.0079 

1.23 

AV 

-6567.2310 

6567.2311 

0.0001 

0.01 

A Y bf 

-5686.3033 

5686.2926 

0.0107 

1.00 

A Z BF 

-6322.3807 

6322.3917 

0.0110 

1.02 


These repeat observations are taken in different sessions and the results com¬ 
pared. The repeat baselines provide checks on held and office procedures and 
aid in isolating poor practices. For example, in the data of Table 17.1, baselines 
AF and BF were repeated. Table 17.3 gives comparisons of these observations 
using the same procedure that was used in Table 17.2. Again, the ppm values 
listed in column (5) use the total baseline lengths in the denominator, which 
are computed from the square root of the sum of the squares of the mea¬ 
sured baseline components. It is wise to perform repeat observations at the 
end of each day to check the repeatability of the software, hardware, and held 
procedures. 

The Federal Geodetic Control Subcommittee (FGCS) has developed a 
document titled “Geometric Geodetic Accuracy Standards and Specifications 
for Using GPS Relative Positioning Techniques.” It is intended to serve as a 
guideline for planning, executing, and classifying geodetic surveys performed 
by GNSS relative positioning methods. This document may be consulted to 
determine whether or not the ppm values of column (5) are acceptable for 
the required order of accuracy for the survey. Besides ppm requirements, 
the FGCS guidelines specify other criteria that must be met for the dif¬ 
ferent orders of accuracy in connection with repeat baseline observations. 
Again the acceptability of the line can be computed based on the FGCS 
guidelines or by comparing the baseline against the manufacturer’s specihed 
accuracies. 

Developing a statistical test for repeat baselines may be impossible since, it 
must be remembered that we are comparing the difference between two obser¬ 
vations. The proper statistical test is demonstrated in Section 18.18. However, 
this test requires the knowledge about each baselines computed error, the 
number of redundant observations, and the total number of observations. 
While the root-mean-square (RMS) error is typically reported by software, 
the number of redundant and total observations is seldom provided in a 
baseline adjustment report. Thus, another approach needs to be considered. 
One method might simply be to see if the linear difference between the two 
baseline observations is greater than the estimated error for a baseline of this 
length. In this case, Equation (17.13) will yield the estimated error in the length 
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of the line, which can be multiplied to an appropriate level of probability. Then, 
similar to the procedures used for fixed baseline observations, the actual error 
can be compared against the estimated value. Although this procedure lacks 
the rigor of a proper statistical test, it should provide enough information 
to isolate baseline observations that have obvious problems. This method is 
demonstrated in Example 17.3 with repeat baselines FA and AF. 

Example 17.3 The manufacturer’s specified accuracy of their GNSS receivers 
during a static survey is 3 mm + 0.5 ppm. The user estimates their setup errors 
to be within ±1.5 mm. Analyze repeat baselines FA and ^4.F from Table 17.1 at 
a 99% level of confidence. 

SOLUTION For simplicity, a table similar to Table 17.3 is created. 


Component 

1st Obs 

2nd Obs 

Difference (m) 

ppm 

AZ 

1116.4577 

-1116.4523 

0.005 

0.84 

AT 

4596.1553 

-4596.1610 

-0.006 

0.89 

AZ 

4355.9141 

-4355.9062 

0.008 

1.23 

Length 

6430.016 

6430.014 

0.0111 

1.73 


The estimated error for this length of a baseline is: 


<7 = 


1 2(1.5 2 ) + 3 2 + 


0.5(6,430,014) 

1,000,000 


= ±4.88 mm 


Since the number of observations used to generate this baseline observation 
during a static survey is greater than 30 typically, a normal distribution multi¬ 
plier can be used to obtain the E 99% value for this error. From Table 3.2, we see 
the appropriate multiplier is 2.576. 


E gg = 2.576(4.88) = ±12.58 mm 

The actual linear difference between the two observations was 11.1 mm. Since 
11.1 mm < 12.58 mm, the difference in the two observations is within the 99% 
range. It should be noted that if either of these baselines are a blunder then more 
advanced statistical techniques discussed in Chapter 21 may catch the obser¬ 
vation that has a blunder during the GNSS network adjustment discussed in 
Section 17.8. These early tests are to ensure that no large blunders are allowed 
to enter into the baseline network adjustment. 
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17.7.3 Analysis of Loop Closures 

GNSS networks will typically consist of many interconnected closed loops. 
For example, in the network of Figure 17.1, a closed loop is formed by points 
ACBDEA. Similarly, ACFA, CFBC, BDFB , and so on, are other closed loops. 
For each closed loop, the algebraic sum of the AX components should equal 
zero. The same condition should exist for the AT and AZ components. These 
loop misclosure conditions are very similar to the leveling loop misclosures 
imposed in differential leveling and latitude and departure misclosures imposed 
in closed-polygon traverses. An unusually large misclosure within any loop will 
indicate that either a blunder or a large random error exists in one (or more) 
of the baselines of the loop. 

To compute loop misclosures, the baseline components are added alge¬ 
braically for the chosen loop. For example, the misclosure in X components 
for loop ACBDEA would be computed as 

cx = AX ac + AX cb + AX bd + AX DE + AX ea (17.14) 

where cx is the loop misclosure in X coordinates. Similar equations apply for 
computing misclosures in Y and Z coordinates. 

Substituting numerical values into Equation (17.14), the misclosure in X 
coordinates for loop ACBDEA is 

cx = 11,644.2232 - 3960.5442 - 11,167.6076 - 1837.7459 + 5321.7164 

= 0.0419 m 

Similarly, misclosures in Y and Z coordinates for that loop are 

cy = 3601.2165 + 6681.2467 - 394.5204 - 6253.8534 - 3634.0754 
= 0.0140 m 

cz = 3399.2550 + 7279.0148 - 907.9593 - 6596.6697 - 3173.6652 
= -0.0244 m 

For evaluation purposes, loop misclosures are expressed in terms of the 
ratios of resultant misclosures to the total loop lengths. They are given in 
ppm. For any loop, the resultant misclosure is the square root of the sum of 
the squares of its cx, cy, and cz values and for loop ACBDEA the resultant is 
0.0505 m. The total length of a loop is computed by summing its legs, each leg 
being computed from the square root of the sum of the squares of its observed 
AX, AY, and AZ values. For loop ACBDEA, the total loop length is 50,967 m, 
and the misclosure ppm ratio is therefore (0.0505/50,967)(1,000,000) = 0.99 
ppm. Again, these ppm ratios can be compared against values given in the 
FGCS guidelines to determine if they are acceptable for the order of accuracy 
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of the survey. As was the case with repeat baseline observations, the FGCS 
guidelines also specify other criteria that must be met in loop analyses besides 
the ppm values. 

These misclosures can also be checked against manufacturer specifications. 
In this case, Equation (17.13) can be modified as 


ff loop = yj2no] + na 2 + (L ■ ppm) 2 (17.15) 

where n is the number of baselines in the loop, L is the overall length of the 
loop, and the other terms are as defined in Equation (17.13). 

Assuming as before an accuracy of 5 mm + 1 ppm and setup errors of 
0.0015 m, the estimated error in the loop is 


^2(5)0.0015= + 5(0.005T + ( T |AL..,)" = ±0.052 m 

Again, the actual misclosure is within the estimated error of the baseline at a 
68% probability. As with Equation (17.13), multipliers derived from the normal 
distribution can be used to estimate errors at any other level of probability. 

For any network, enough loop closures should be computed so that every 
baseline is included within at least one loop. This should expose any large 
blunders that exist. If a blunder does exist, its location can be determined 
through additional loop-closure analyses often. For example, assume that 
the misclosure of loop ACDEA discloses the presence of a blunder. By also 
computing the misclosures of loops AFCA, CFDC, DFED, and EFAE , the 
baseline containing the blunder can often be detected. In this example, if a 
large misclosure was found in loop DFED and all other loops appeared to be 
blunder free, the blunder could be in line DE. 

A computer program included within the software package ADJUST can 
determine these loop-closure computations. Figure 17.5 shows the resultant 
loop misclosures. The “LC” column lists the actual misclosure of each loop. 
The “s” column list the estimated error in the loop based on user-supplied 
setup errors, and estimated errors in the observed GPS baseline vectors. 


Loop Misclosure 


Distance 

dx 

dy 

dz 

LC 

s 

ppm 

Loop 


12,860.030 

0.005 

-0.006 

0.008 

0.011 

0.015 

0.9 

7 

13 


50,966.697 

0.042 

0.014 

-0.024 

0.050 

0.052 

1.0 

1 

3 

4 i 

29,701.415 

0.020 

0.001 

0.034 

0.040 

0.031 

1.3 

13 

8 

1 

37,054.577 

0.001 

0.011 

-0.003 

0.011 

0.038 

0.3 

8 

10 

5 

24,748.975 

-0.012 

0.005 

0.008 

0.015 

0.026 

0.6 

10 

9 

6 

20,229.388 

-0.038 

-0.011 

-0.018 

0.043 

0.022 

2.1 

9 

13 

2 


FIGURE 17.5 Results of loop misclosure computations for example in Section 17.7.3. 
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14 

1 A C 11644.2232 3601.2165 3399.2550 

2 A E -5321.7164 3634.0754 3173.6652 

3 B C 3960.5442 -6681.2467 -7279.0148 

4 B D -11167.6076 -394.5204 -907.9593 

5 D C 15128.1647 -6286.7054 -6371.0583 

6 D E -1837.7459 -6253.8534 -6596.6697 

7 F A -1116.4523 -4596.1610 -4355.9062 

8 F C 10527.7852 -994.9377 -956.6246 

9 F E -6438.1364 -962.0694 -1182.2305 

10 F D -4600.3787 5291.7785 5414.4311 

11 F B 6567.2311 5686.2926 6322.3917 

12 B F -6567.2310 -5686.3033 -6322.3807 

13 A F 1116.4577 4596.1553 4355.9141 

14 A B 7683.6620 10282.4234 10678.2972 

7 13 

1 3 4 6 2 
13 8 1 

8 10 5 
10 9 6 

9 13 2 

FIGURE 17.6 ADJUST data file for computing loop misclosure as discussed in 
Section 17.7.3. 


This column is at 68% and must be multiplied by the appropriate multiplier 
to raise it to another level of probability. Finally, the “ppm” column lists the 
computed parts-per-million error for each loop. The help hie that accompanies 
the software explains the format of the data hie shown in Figure 17.6. This 
hie lists the number of baseline vectors (14) followed by the each baseline 
vector with a consecutive number. These numbers are used to determine which 
baseline vectors are included in any loop. This particular hie lists the six loops 
discussed previously. For example, loop ACBDEA is dehned as “1 3 4 6 2” 
where “1” is baseline AC, “3” is BC, and so on. As can be seen with baseline 
EA, the software will automatically reverse the signs of the baseline vector 
components when the letters are shown in the reverse order. 

17.7.4 Minimally Constrained Adjustment 

Prior to making the hnal adjustment of baseline observations in a network, 
a “minimally constrained” least squares adjustment is usually performed. 
In this adjustment, sometimes called a “free” adjustment, any station in the 
network may be held hxed with arbitrary coordinates. All other stations in 
the network are therefore free to adjust as necessary to accommodate the 
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baseline observations and network geometry. The residuals that result from 
this adjustment are strictly related to the baseline observations and not to 
faulty control coordinates. These residuals are examined and, from them, 
blunders that may have gone undetected through the first set of analyses 
can be found and eliminated. Often these adjustments use statistical blunder 
detection methods discussed in Chapter 21. 


17.8 LEAST SQUARES ADJUSTMENT OF GNSS NETWORKS 

As noted earlier, because GNSS networks contain redundant observa¬ 
tions, they must be adjusted to make all coordinate differences consistent. 
In applying least squares to the problem of adjusting baselines in GNSS 
networks, observation equations are written that relate station coordinates 
to the observed coordinate differences and their residual errors. To illustrate 
this procedure, consider the example of Figure 17.1. For line AC of this 
figure, an observation equation can be written for each observed baseline 
component as 

x c = x a + ^ x ac + v x AC 

Y c =Ya + ^Y ac + v y AC (17.16) 

= Z A + A Z AC + v Zac 

Similarly the observation equations for the baseline components of line 
CD are 

X D = X c + AX cd + v Xcd 

Yd = Yc + A Y cd + v y cd (17.17) 

Z D = Z c + A Z CD + v Zcd 

Observation equations of the form above are written for all observed base¬ 
lines in any figure. For Figure 17.1 there were a total of 13 observed baselines, 
so the number of observation equations that can be developed is 39. Also each 
of stations C, D, E, and F, has three unknown coordinates, for a total of 12 
unknowns in the problem. Thus, there are 39 - 12 = 27 redundant observa¬ 
tions in the network. The 39 observation equations can be expressed in matrix 
form as 

AX=L+V (17.18) 

If the observation equations for adjusting the network of Figure 17.1 are 
written in the same order that the observations are listed in Table 17.1, the 
A, X, L, and V matrices are 
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A = 


10 0 0 
0 10 0 
0 0 10 
0 0 0 1 
0 0 0 0 
0 0 0 0 
10 0 0 
0 10 0 
0 0 10 
0 0 0 0 
0 0 0 0 
0 0 0 0 
10 0 0 
0 10 0 
0 0 10 
0 0 0 1 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 0 0 
10 0 0 
0 10 0 
0 0 10 
0 0 0 1 
0 0 0 0 


0 0 0 

0 0 0 

0 0 0 

0 0 0 

1 0 0 

0 1 0 

0 0 0 

0 0 0 

0 0 0 

0 0 1 

0 0 0 

0 0 0 

0 0-1 
0 0 0 

0 0 0 

0 0-1 
1 0 0 

0 1 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

1 0 0 


0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

1 0 

0 1 
0 0 

-1 0 

0 -1 

0 0 

-1 0 

0 -1 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 


000001 0 0 0 


0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

0 0 0 

-10 0 

0-10 
0 0-1 

-10 0 

0-10 
0 0-1 

-10 0 

0-10 
0 0-1 


0000000 0 0 1 0 0 
0000000 0 0 0 1 0 
0000000 0 0 0 0 1 


X-- 


x r 


X r 




X c 


L = 


12046.5741 


V X 

a AC 

-4649394.0846 


Vy 

r AC 

4353160.0325 


v z 

^AC 

-4919.3655 


v y 

a AE 

-4649361.2257 


Vy 

1 AE 

4352934.4427 


V 7 

a AE 

12046.5760 


Vy 

A BC 

-4649394.0941 


Vy 

1 BC 

4353160.0685 


V 7 

a bc 

-3081.5758 


Vy 

a bd 

-46443107.3678 


Vy 

1 BD 

4359531.1240 


V 7 

A BD 

15128.1647 


Vy 

a dc 

-6286.7054 


Vy 
* DC 

-6371.0583 


V z 

^DC 

-1837.7459 

V = 

Vy 

a DE 

-6253.8534 


Vy 

r DE 

-6596.6697 


v 7 

^DE 

-1518.8032 


Vy 

a FA 

4648399.1401 


Vy 

r FA 

-4354116.6737 


v z 

^FA 

10527.7852 


v x 

a fc 

-994.9377 


Vy 

J FC 

-956.6246 


v z 

t'FC 

-6438.1364 


a fe 

-962.0694 


V y 

1 FE 

-1182.2305 


v z 

t'FE 

1518.8086 


v x 

a AF 

-4648399.1458 


Vy 

1 AF 

4354116.6916 


v z 

L ^AF - 1 
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The numerical values of the elements of the L matrix are determined by 
rearranging the observation equations. Its first three elements are for the AX, 
AT, AZ baseline components of line AC, respectively. Those elements are 
calculated as follows 

L x = x a + 

Ly= Y a +AY ac (17.19) 

L z = Z A + AZ ac 

The other elements of the L matrix are formed in the same manner as 
demonstrated for baseline AC. However before numerical values for the 
L matrix elements can be obtained, the X e , Y e , Z e geocentric coordinates of all 
control points in the network must be computed. This is done by following the 
procedures described in Section 17.5 and demonstrated by Example 17.1. That 
example problem provided the X e , Y e , Z e coordinates of control points A and 
B of Figure 17.1, which are used to compute the elements of the L matrix 
given above. 

Note that the observation equations for GNSS network adjustment are lin¬ 
ear and that the only nonzero elements of the A matrix are either 1 or — 1. 
This is the same type of matrix that was developed in adjusting differential 
leveling networks by least squares. In fact, GNSS network adjustments are per¬ 
formed in the very same manner, with the exception of the stochastic model. 
In relative positioning, the three observed baseline components are correlated. 
Therefore, a covariance matrix of dimensions 3 X 3 is derived for each baseline 
as a product of the least squares adjustment of the carrier phase observations. 
This covariance matrix is used to weight the observations in the network adjust¬ 
ment in accordance with Equation (10.4). The weight matrix for any GNSS 
network is therefore a block-diagonal type, with an individual 3x3 matrix 
for each observed baseline on the diagonal. When more than two receivers 
are used, additional 3x3 matrices are created in the off-diagonal region of 
the matrix to provide the correlation that exists between the simultaneously 
observed baselines. All other elements of the matrix are zeros. Since commercial 
software computes individual baseline vectors, the correlation (off-diagonal 
3x3 matrices) between simultaneously observed baseline vectors using three 
or more receivers is not determined. This fact results in a stochastic model that 
is incorrect theoretically and can cause problems in post-adjustment statistical 
analysis. 

The covariances for the observations in Table 17.1 are given in columns 
(6) through (11). Only the six lower-triangular elements of the 3x3 covari¬ 
ance matrix for each observation are listed. However, because the covariance 
matrix is symmetrical, this gives complete weighting information. Columns 6 
through 11 list a , a xz , a 2 , a , and <r 2 , respectively. Thus, the full 3x3 
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covariance matrix for baseline AC is 


9.884F-4 

-9.580F-6 

9.520 E 

-9.580F-6 

9.377F-4 

-9.520 E 

9.520F-6 

-9.520F - 6 

9.827 E 


The complete weight matrix for the example network of Figure 17.1 has 
dimensions of 39 X 39. After inverting the full matrix and multiplying by the 
a priori estimate for the reference variance, S^, in accordance with Equation 
(10.4), the weight matrix for the network of Figure 17.1 is as follows. (Note 
that S~ is taken as 1.0 for this computation, and that no correlation between 
separate baselines is included.) 


1011.8 10.2 -9.7 0 

10.2 1066.6 10.2 0 

-9.7 10.2 1017.7 0 

0 0 0 4634.5 

0 0 0 50.2 

0 0 0 -49.4 

0 0 0 0 

0 0 0 0 

0 0 0 0 


0 0 0 
0 0 0 
0 0 0 
50.2 -49.4 0 

5209.7 54.0 0 

54.0 4988.1 0 

0 0 4339.1 

0 0 37.7 

0 0 -39.5 


0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
37.7 -39.5 
3927.8 38.5 

38.5 4441.0 


0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 


0 0 0 0 0 
0 0 0 0 0 
0 0 0 0 0 


0 0 0 
0 0 0 
0 0 0 


0 15111.8 147.7 -143.8 

0 147.7 12336.0 106.5 

0 -143.8 106.5 10667.8 


The system of observation Equations (17.8) is solved by least squares using 
Equation (11.35). This yields the most probable values for the coordinates 
of the unknown stations. The ADJUST data hie is shown in Figure 17.7. As 
with other ADJUST data hies, the first line is a description of the contents 
of the hie. This line is followed with the number of control stations, number 
of unknown stations, and number of baseline vectors. The control stations 
are listed with a point identifier that cannot contain a space, comma, or tab 


Example from Section 17.8 
2 4 13 

A 402.35087 -4652995.30109 4349760.77753 

B 8086.03178 -4642712.84739 4360439.08326 

A C 11644.2232 3601.2165 3399.2550 0.00098848 -0.00000958 0.00000952 0.00093777 -0.00000952 0.00098279 
A E -5321.7164 3634.0754 3173.6652 0.00021582 -0.00000210 0.00000216 0.00019199 -0.00000210 0.00020052 
B C 3960.5442 -6681.2467 -7279.0148 0.00023050 -0.00000223 0.00000207 0.00025464 -0.00000223 0.00022521 
B D -11167.6076 -394.5204 -907.9593 0.00027006 -0.00000275 0.00000285 0.00027210 -0.00000272 0.00026707 

D C 15128.1647 -6286.7054 -6371.0583 0.00014610 -0.00000143 0.00000134 0.00016145 -0.00000144 0.00013086 

D E -1837.7459 -6253.8534 -6596.6697 0.00012311 -0.00000119 0.00000122 0.00012770 -0.00000121 0.00012830 

T A -1116.4523 -4596.1610 -4355.9062 0.00007475 -0.00000079 0.00000088 0.00006593 -0.00000081 0.00007616 

F C 10527.7852 -994.9377 -956.6246 0.00025671 -0.00000225 0.00000240 0.00021639 -0.00000227 0.00023977 
F E -6438.1364 -962.0694 -1182.2305 0.00009442 -0.00000092 0.00000104 0.00009959 -0.00000089 0.00008826 
F D -4600.3787 5291.7785 5414.4311 0.00009330 -0.00000099 0.00000090 0.00009875 -0.00000099 0.00012045 
F B 6567.2311 5686.2926 6322.3917 0.00006643 -0.00000065 0.00000069 0.00007465 -0.00000064 0.00006048 
B F -6567.2310 -5686.3033 -6322.3807 0.00005512 -0.00000063 0.00000061 0.00007472 -0.00000063 0.00006629 
A F 1116.4577 4596.1553 4355.9141 0.00006619 -0.00000080 0.00000090 0.00008108 -0.00000082 0.00009376 
A B 7683.6620 10282.4234 10678.2972 0.00072397 -0.00000728 0.00000752 0.00067618 -0.00000729 0.00073104 


FIGURE 17.7 ADJUST data file for the example in Section 17.8. 
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since these characters are used as entry delimiters. The point identifier is 
followed by the point’s geocentric coordinates in the order of X, Y, and Z. 
Following the control station entries is a listing of each baseline vector. These 
lines have the format of the primary station identifier, secondary station 
identifier, baseline vector components of AX, AT, and AZ. The baseline vector 
components are followed by the covariance elements for the vector given in 
the same order as listed in Table 17.1. The ADJUST data hie Example from 
Section 17-8.dat is available on the companion website for this book. For 
those wishing to program in a higher-level language, the Mathcad worksheet 
Cl 7. xmcd is available on the companion website. A listing of the adjustment 
of the data in Figure 17.1 obtained using the program ADJUST follows. 


Control stations 


Station 

X 

Y 

z 

A 

402.35087 

-4652995.30109 

4349760.77753 

B 

8086.03178 

-4642712.84739 

4360439.08326 

Distance Vectors 

From To AX 

AY AZ 

Covariance matrix elements 



A 

C 

11644.2232 

3601.2165 

3399.2550 

9.884E-4 

-9.580E-6 

9.520E-6 

9.377E-4 

-9.520E-6 

9.827E-4 

A 

E 

-5321.7164 

3634.0754 

3173.6652 

2.158E-4 

-2.100E-6 

2.160E-6 

1.919E-4 

-2.100E-6 

2.005E-4 

B 

C 

3960.5442 

-6681.2467 

-7279.0148 

2.305E-4 

-2.230E-6 

2.070E-6 

2.546E-4 

-2.230E-6 

2.252E-4 

B 

D 

-11167.6076 

-394.5204 

-907.9593 

2.700E-4 

-2.750E-6 

2.850E-6 

2.721E-4 

-2.720E-6 

2.670E-4 

D 

C 

15128.1647 

-6286.7054 

-6371.0583 

1.461E-4 

-1.430E-6 

1.340E-6 

1.614E-4 

-1.440E-6 

1.308E-4 

D 

E 

-1837.7459 

-6253.8534 

-6596.6697 

1.231E-4 

-1.190E-6 

1.220E-6 

1.277E-4 

-1.210E-6 

1.283E-4 

F 

A 

-1116.4523 

-4596.1610 

-4355.8962 

7.475E-5 

-7.900E-7 

8.800E-7 

6.593E-5 

-8.100E-7 

7.616E-5 

F 

C 

10527.7852 

-994.9377 

-956.6246 

2.567E-4 

-2.250E-6 

2.400E-6 

2.163E-4 

-2.270E-6 

2.397E-4 

F 

E 

-6438.1364 

-962.0694 

-1182.2305 

9.442E-5 

-9.200E-7 

1.040E-6 

9.959E-5 

-8.900E-7 

8.826E-5 

F 

D 

-4600.3787 

5291.7785 

5414.4311 

9.330E-5 

-9.900E-7 

9.000E-7 

9.875E-5 

-9.900E-7 

1.204E-4 

F 

B 

6567.2311 

5686.2926 

6322.3917 

6.643E-5 

-6.500E-7 

6.900E-7 

7.465E-5 

-6.400E-7 

6.048E-5 

B 

F 

-6567.2310 

-5686.3033 

-6322.3807 

5.512E-5 

-6.300E-7 

6.100E-7 

7.472E-5 

-6.300E-7 

6.629E-5 

A 

F 

1116.4577 

4596.1553 

4355.9141 

6.619E-5 

-8.000E-7 

9.000E-7 

8.108E-5 

-8.200E-7 

9.376E-5 


Normal Matrix 


16093.0 

148.0 

-157.3 

0 

0 

0 

-6845.9 

-60.0 

69.4 

-3896.2 

-40.1 

38.6 

148.0 

15811.5 

159.7 

0 

0 

0 

-60.0 

-6195.0 

-67.6 

-40.1 

-4622.2 

-43.4 

157.3 

159.7 

17273.4 

0 

0 

0 

69.4 

-67.6 

-7643.2 

38.6 

-43.4 

-4171.5 

0 

0 

0 

23352.1 

221.9 

-249.8 

-8124.3 

-75.0 

76.5 

-10593.3 

-96.8 

123.8 

0 

0 

0 

221.9 

23084.9 

227.3 

-75.0 

-7832.2 

-73.2 

-96.8 

-10043.0 

-100.1 

0 

0 

0 

-249.8 

227.3 

24116.4 

76.5 

-73.2 

-7795.7 

123.8 

-100.1 

-11332.6 

6845.9 

-60.0 

69.4 

-8124.3 

-75.0 

76.5 

29393.8 

278.7 

-264.4 

-10720.0 

-106.7 

79.2 

60.0 

-6195.0 

-67.6 

-75.0 

-7832.2 

-73.2 

278.7 

27831.6 

260.2 

-106.7 

-10128.5 

-82.5 

69.4 

-67.6 

-7643.2 

76.5 

-73.2 

-7795.7 

-264.4 

260.2 

27487.5 

79.2 

-82.5 

-8303.5 

3896.2 

-40.1 

38.6 

-10593.3 

-96.8 

123.8 

-10720.0 

-106.7 

79.2 

86904.9 

830.9 

-874.3 

40.1 

-4622.2 

-43.4 

-96.8 

-10043.0 

-100.1 

-106.7 

-10128.5 

-82.5 

830.9 

79084.9 

758.1 

38.6 

-43.4 

-4171.5 

123.8 

-100.1 

-11332.6 

79.2 

-82.5 

-8303.5 

-874.3 

758.1 

79234.9 


Constant Matrix 


227790228.2336 

23050461170.3104 

23480815458.7631 

554038059.5699 

24047087640.5196 
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21B97654262.6187 

491968929.7795 

16764436256.9406 

16302821193.7660 

5314817963.4907 

250088821081.7488 

238833986695.9468 


X Matrix 


12046.5808 

4649394.0826 

4353160.0634 

4919.3391 

4649361.2199 

4352934.4534 

3081.5831 

4643107.3692 

4359531.1220 

1518.8012 

4648399.1453 

4354116.6894 

Degrees of Freedom = 27 
Reference Variance = 0.6135 
Reference So = ±0.78 

Adjusted Distance Vectors 


From 

To 

AX 

AY 

AZ 

Vx 

Vy 

V z 

A 

C 

11644.2232 

3601.2165 

3399.2550 

0.00669 

0.00203 

0.03082 

A 

E 

-5321.7164 

3634.0754 

3173.6652 

0.02645 

0.00582 

0.01068 

B 

C 

3960.5442 

-6681.2467 

-7279.0148 

0.00478 

0.01153 

-0.00511 

B 

D 

-11167.6076 

-394.5204 

-907.9593 

-0.00731 

-0.00136 

-0.00194 

D 

C 

15128.1647 

-6286.7054 

-6371.0583 

-0.00081 

-0.00801 

-0.00037 

D 

E 

-1837.7459 

-6253.8534 

-6596.6697 

-0.01005 

0.00268 

0.00109 

F 

A 

-1116.4523 

-4596.1610 

-4355.8962 

0.00198 

0.00524 

-0.01563 

F 

C 

10527.7852 

-994.9377 

-956.6246 

-0.00563 

0.00047 

-0.00140 

F 

E 

-6438.1364 

-962.0694 

-1182.2305 

-0.00387 

-0.00514 

-0.00545 

F 

D 

-4600.3787 

5291.7785 

5414.4311 

-0.00561 

-0.00232 

0.00156 

F 

B 

6567.2311 

5686.2926 

6322.3917 

-0.00051 

0.00534 

0.00220 

B 

F 

-6567.2310 

-5686.3033 

-6322.3807 

0.00041 

0.00536 

-0.01320 

A 

F 

1116.4577 

4596.1553 

4355.9141 

-0.00738 

0.00046 

-0.00227 


Advanced Statistical Values 


From 

To 

±S 

Slope Dist 

Prec 

A 

C 

0.0116 

12,653.537 

1,089,000 

A 

E 

0.0100 

7,183.255 

717,000 

B 

C 

0.0116 

10,644.669 

916,000 

B 

D 

0.0097 

11,211.408 

1,158,000 

D 

C 

0.0118 

17,577.670 

1,484,000 
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D 

E 

0.0107 

9,273.836 

868,000 



F 

A 

0.0053 

6,430.014 

1,214,000 



F 

C 

0.0115 

10,617.871 

921,000 



F 

E 

0.0095 

6,616.111 

696,000 



F 

D 

0.0092 

8,859.036 

964,000 



F 

B 

0.0053 

10,744.076 

2,029,000 



B 

F 

0.0053 

10,744.076 

2,029,000 



A 

F 

0.0053 

6,430.014 

1,214,000 


Adjusted 

Coordinates 





Station 


X 

Y 

Z 

Sx Sy 

Sz 

A 


402.35087 

-4,652,995.30109 

4,349,760.77753 



B 


8,086.03178 

-4,642,712.84739 

4,360,439.08326 



C 


12,046.58076 

-4,649,394.08256 

4,353,160.06335 

0.0067 0.0068 

0.0066 

E 


-4,919.33908 

-4,649,361.21987 

4,352,934.45341 

0.0058 0.0058 

0.0057 

D 


-3,081.58313 

-4,643,107.36915 

4,359,531.12202 

0.0055 0.0056 

0.0057 

F 


1,518.80119 

-4,648,399.14533 

4,354,116.68936 

0.0030 0.0031 

0.0031 


PROBLEMS 

Note: For problems requiring least squares adjustment, if a computer program 
is not distinctly specified for use in the problem, it is expected that the least 
squares algorithm will be solved using the program MATRIX, which is on the 
companion website for this book. Partial solutions to problems marked with 
an asterisk are given in Appendix H. 

17.1 Using WGS 84 ellipsoid parameters, convert the following geodetic 
coordinates to geocentric coordinates for these points. 

*(a) 0: 39°23' 15.2034" N, A: 79°05'53.2957" W, h: 264.248 m 

(b) <p: 43° 15'15.2945" N, A: 89°52'46.2047" W, h: 239.085 m 

(c) 0: 38°12'03.4962" N, A: 110°52'33.3331" W, h: 1408.164 m 

(d) (p: 55°19'02.0487" N, A: 120°07'02.0082" W, h: 125.248 m 

17.2 Using the WGS 84 ellipsoid parameters convert the following geocen¬ 
tric coordinates (in meters) to geodetic coordinates for these points. 
*(a) X= -2,269,821.297; Y= -3,613,410.945; Z = 4,724,567.664 

(b) X= -928,062.869; Y= -2,497,668.319; Z = 5,777,463.097 

(c) X= -280,144.005; Y= -5,273,020.857; Z = 3,565,762.940 

(d) X= 1,159,082.570; Y= -4,656,627.142; Z = 4,187,966.025 

17.3 Given the following GNSS observations and geocentric control station 
coordinates to Figure PI7.3, identify the following: 

*(a) The most probable coordinates and their standard deviations for 
stations B and C. 

(b) The adjusted baseline vector components and their residuals. 
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*(c) The standard deviation of unit weight. 

(d) The adjusted geodetic coordinates for stations B and C. 



Control Stations 

ID 

X (m) 

Y{ m) 

Z (m) 

A 

365,767.198 

-4,627,798.316 

4,359,647.156 

D 

359,490.412 

-4,624,911.507 

4,363,217.118 


All the data were collected with only two receivers and the vector 
covariance matrices for the AX, AY, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX = -7720.703 3.00E-5 

A T= -1024.518 
AZ = -398.037 


1.06E-6 1.32E-5 

3.1 IE—5 3.05E-7 

2.99E-5 


For baseline BC\ 


AX = -5011.741 2.06E-5 1.31E-6 
A F= 1576.876 2.05E-5 

AZ = 2049.280 


-4.19E-8 
5.56E-7 
2.1 IE—5 


For baseline CD: 


AX = 6455.640 2.65E-5 5.90E-7 
A T= 2334.433 2.66E-5 

AZ= 1918.721 


3.34E-7 

7.00E-7 

2.75E-5 


For baseline AC: 


AX = -12,732.426 6.42E-5 

A T= 552.369 
AZ = 1651.241 


8.54E-7 3.03E-7 

6.47E-5 2.72E-6 

6.54E-5 
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For baseline BD: 


AX= 1433.905 2.12E-5 2.30E-7 5.94E-7 

A Y= 3911.321 2.07E-5 3.69E-7 

AZ= 3968.003 2.12E-5 


For baseline DA: (Do not use in adjustment.) 

AX= 6276.790 2.97E-5 7.33E-7 3.77E-7 
AF=-2886.799 2.90E-5 1.53E-6 

AZ=-3569.963 2.95E-5 


17.4 Using the data in Problem 17.3 and static survey specifications of 
3 mm + 0.5 ppm with setup errors of ±1.5 mm analyze the following 
at a 99.7% level of confidence. 

*(a) The check baseline DA. 

(b) The loops ABC A and ACDA. 

(c) Perform a x 2 test on the adjustment in Problem 17.3 at a 0.05 level 
of significance. 

17.5 Repeat Problem 17.3 with the following set of data. 


Control Stations 


ID 

X(m) 

Y (m) 

Z(m) 

A 

1,723,309.360 

-4,623,094.906 

4,032,093.553 

D 

1,710,320.166 

-4,620,086.358 

4,041,371.072 



FIGURE P17.5 
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All the data were collected with only two receivers and the vector 
covariance matrices for the AX, A Y, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX = -8873.997 4.31E-5 2.07E-7 
A Y= 4447.486 4.43E-5 

A Z = 1420.871 


-5.56E-6 
1.1 IE—6 
4.31E-5 


For baseline BC\ 


AX= 9755.952 7.98E-5 

A Y= 4920.549 
AZ = 9386.086 


2.93E-6 1.25E-6 

7.96E-5 2.11E-6 

8.09E-5 


For baseline CD: 


AX = 12,107.214 4.54E-5 

A F= -6,359.513 
AZ=-1,529.441 


-3.76E-6 7.79E-7 

7.23E-5 1.45E-6 

7.47E-5 


For baseline AC: 


AX = 881.978 5.03E-5 

A Y= 9368.052 
AZ= 10,806.959 


1.37E-6 1.59E-7 

7.81E-5 3.16E-6 

7.94E-5 


For baseline BD: 


AX= 21,863.174 
A F= -1,438.936 
AZ = 7,856.647 


1.93E-4 -3.33E-6 4.61E-5 

1.86E-4 -8.52E-7 

1.95E-4 


For baseline DA: (Do not use in adjustment.) 


AX=-12,989.187 9.56E-5 1.30E-6 2.30E-6 
AF=-3,008.530 9.65E-5 2.18E-6 

AZ=-9,277.520 9.50E-5 


17.6 Using the data in Problem 17.5 and static survey specifications of 
3 mm + 0.5 ppm with setup errors of ±1.5 mm, analyze the following 
at a 99.7% level of confidence. 

(a) The check baseline DA. 

(b) The loops ABC A and ACDA. 

(c) Perform a / 2 test on the adjustment in Problem 17.5 at a 0.05 level 
of significance. 
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17.7 Given the following GNSS observations and geocentric control station 
coordinates to Figure P17.7, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted stations? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

(d) the adjusted geodetic coordinates for the stations? 


Control Station 


ID 

X (m) 

F(m) 

Z( m) 

A 

2,681.756 

-4,652,569.792 

4,348,467.482 



FIGURE P17.7 


All the data were collected with only two receivers and the vector 
covariance matrices for the AX, AY, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX =4449.305 
AF= 4841.860 
AZ= 5152.851 


1.66E-3 5.87E-5 7.32E-5 

1.73E-3 1.70E-5 

1.66E-3 


For baseline BC: 


AX=-3561.840 1.68E-3 

A F= 1659.116 
A Z= 1711.764 


1.07E-4 -3.42E-6 

1.68E-3 4.54E-5 

1.73E-3 


For baseline CD: 


AX = -9760.380 
A F= -5722.949 
AZ= -6071.920 


1.66E-3 3.71E-5 2.10E-5 

1.67E-3 4.39E-5 

1.73E-3 
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For baseline DA: 


AX = 8872.801 
AF= -778.190 
AZ= -792.698 

1.66E-3 

2.20E-5 

1.67E-3 

7.82E-6 

7.03E-5 

1.69E-3 

For baseline AC: 

AX — 887.559 
AF= 6501.142 
AZ = 6864.594 

1.70E-3 

1.85E-5 

1.66E-3 

4.77E-5 

2.96E-5 

1.70E-3 


17.8 Use the data in Problem 17.7 and static survey specifications of 5 mm + 
0.5 ppm with setup errors of ±0.0015 m to answer the following: 

(a) Analyze the loops ADCA and ACBA at a 99.7% level of 
confidence. 

(b) Perform a / 2 test on the adjustment in Problem 17.7 at a 0.05 level 
of significance. 

17.9 Repeat Problem 17.7 with the following set of data. 


Control Station 


ID 

X(m) 

Y (m) 

Z(m) 

A 

2,681.756 

-4,652,569.792 

4,348,467.482 


All the data were collected with only two receivers and the vector 
covariance matrices for the AX, AY, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX = 3449.378 
AF= 4841.932 
AZ= 5152.811 


1.42E-5 4.99E-7 6.23E-6 

1.47E-5 1.44E-7 

1.42E-5 


For baseline BC: 


AX = -3561.818 
A F= 1659.155 
AZ= 1711.806 


1.07E-5 6.81E-7 -2.17E-8 

1.07E-5 2.89E-7 

1.10E-5 


For baseline CD: 


AX = -6760.347 
Af= -5722.930 
AZ= -6071.922 


1.85E-5 4.12E-7 2.33E-7 

1.86E-5 4.89E-7 

1.92E-5 
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For baseline DA : 


AX = 6872.776 1.30E-5 

AF = -778.171 
AZ= -792.695 


1.73E-7 6.13E-8 

1.31 E—5 5.51E-7 

1.32E-5 


For baseline AC: 


AX = -112.432 1.68E-5 

AF= 6501.102 
A Z= 6864.615 


1.82E-7 4.71E-7 

1.64E-5 2.92E-7 

1.68E-5 


17.10 Use the data in Problem 17.9 and static survey specifications of 5 mm + 
1 ppm with setup errors of ±1.5 mm: 

(a) Analyze the loops ADCA and ACBA at a 99.7% level of 
confidence. 

(b) Perform a % 2 test on the adjustment in Problem 17.9 at a 0.05 level 
of significance. 

17.11 Given the following GNSS observations and geocentric control station 
coordinates to Figure P17.ll, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted station? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

(d) the adjusted geodetic coordinates for the station? 



FIGURE P17.ll 


Control Stations 


ID 

X(m) 

Y (m) 

Z (m) 

A 

1,160,360.804 

-4,656,388.174 

4,187,939.703 

B 

1,161,561.719 

-4,656,562.759 

4,187,444.144 

C 

1,161,098.348 

-4,655,636.456 

4,188,599.069 

D 

1,160,583.160 

-4,655,767.430 

4,188,598.439 
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The vector covariance matrices for the AX, AY, and AZ values (in 
meters) given are as follows. For baseline AE: 


AX = 579.869 3.76E-6 8.69E-8 
A Y= 291.820 3.88E-6 

AZ = 177.946 


1.04E-7 

6.75E-8 

3.77E-6 


For baseline BE: 


AX= -621.047 
A F= 466.403 
A Z= 673.509 


3.86E-6 1.82E-7 7.35E-9 

3.87E-6 1.97E-7 

3.94E-6 


For baseline CE: 


AX= -157.675 
Af= -459.901 
AZ= -481.418 


3.71E-6 8.33E-8 -4.78E-7 

3.77E-6 1.31E-7 

3.88E-6 


For baseline DE: 


AX= 357.510 
AF= -328.927 
AZ= -480.788 


3.75E-6 4.87E-8 4.73E-8 

3.78E-6 1.24E-7 

3.81E-6 


17.12 Given the additional GNSS observations for Problem 17.11, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted station? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

The vector covariance matrices for the AX, AT, and AZ values (in 
meters) given are as follows. For baseline EA: 


AX = -579.867 
A F= -291.814 
AZ= -177.949 

For baseline EB: 

AX = -621.047 
AF= -466.398 
AZ= -673.507 


3.85E-6 


4.18E-8 

3.75E-6 


9.38E-8 

3.71E-6 


1.08E-7 

6.69E-8 

3.84E-6 


4.82E-8 

1.96E-7 

3.77E-6 


3.80E-6 
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For baseline EC: 


AX = 157.679 3.87E-6 7.08E-8 
A Y= 459.904 3.68E-6 

AZ = 481.415 


-3.53E-7 

1.59E-7 

3.80E-6 


For baseline ED: 


AX = -357.513 
A F= 328.927 
AZ = 480.785 


3.83E-6 6.74E-8 9.30E-8 

3.84E-6 -4.92E-9 

3.79E-6 


17.13 Assuming a setup error of ± 1 mm and a manufacturer’s specified accu¬ 
racy for a static survey of 3 mm + 0.5 ppm analyze the following repeat 
baselines from Problems 17.11 and 17.12 at a 0.01 level of significance. 
*(a) Baselines AE and EA. 

(b) Baselines BE and EB. 

(c) Baselines CE and EC. 

(d) Baselines DE and ED. 

17.14 Repeat Problem 17.11 with the following set of data. 


Control Station 


ID 

X (m) 

Y( m) 

Z(m) 

A 

5,253,775.717 

2,606,866.667 

-2,498,350.757 


All the data were collected with only two receivers and the vector 
covariance matrices for the AX, A Y, and AZ values (in meters) given 
are as follows. For baseline AE: 


AX = 16,114.750 2.86E-5 

AF = -4026.656 
AZ= -3170.314 


3.47E-6 4.82E-7 

3.40E-5 -5.01E-8 

3.27E-5 


For baseline BE: 


AX= 2310.186 
A Y= 15,680.999 
AZ = 12,411.030 


5.70E-5 2.46E-6 3.55E-7 

4.32E-5 1.27E-6 

4.54E-5 
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For baseline CE: 


AX = -9221.011 2.76E-5 6.62E-7 
A Y= -7698.723 2.76E-5 

AZ= -9101.706 


6.61E-6 

9.21E-7 

2.88E-5 


For baseline DE: 


AX = -2108.823 3.61E-5 5.52E-7 

A Y= -14,130.902 3.66E-5 

AZ= -11,227.559 


-4.07E-7 

8.63E-7 

3.70E-5 


17.15 Given the additional GNSS observations for Problem 17.14, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted station? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

The vector covariance matrices for the AX, AY, and AZ values (in 
meters) given are as follows. For baseline EA: 


AX= -16,114.762 
A Y= 4026.651 
AZ= -3170.311 


3.36E-5 -5.73E-6 6.95E-7 

3.25E-5 8.38E-7 

3.41E-5 


For baseline EB: 


AX = —2310.185 4.19E-5 

A F= -15,680.995 
AZ=-12,411.037 


6.68E-6 5.94E-7 

4.02E-5 1.42E-6 

4.17E-5 


For baseline EC: 


AX = 9221.013 2.85E-5 5.80E-7 
A Y= 7698.725 2.69E-5 

AZ = 9101.699 


1.3 IE—6 
6.80E-7 
2.81E-5 


For baseline ED: 


AX = 2108.821 3.72E-5 

A F= 14,130.895 
AZ= 11,227.551 


5.19E-7 2.87E-7 

3.69E-5 1.43E-7 

3.66E-5 
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17.16 Analyze the following repeat baselines from Problems 17.11 and 17.12. 

(a) Baselines AE and EA. 

(b) Baselines BE and EB. 

(c) Baselines CE and EC. 

(d) Baselines DE and ED. 

17.17 Given the following GNSS observations and geocentric control station 
coordinates to Figure P17.17, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted stations? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

(d) the adjusted geodetic coordinates for the stations? 



Control Stations 

ID 

X (m) 

Y (m) 

Z(m) 

A 

-1,821,920.698 

-1,912,673.386 

5,785,982.359 

C 

-1,831,286.514 

-1,903,747.435 

5,785,965.865 


All the data were collected with only two receivers, and the vector 
covariance matrices for the AX, A Y, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX = 4233.323 9.42E-5 

AF= 14,254.897 
AZ= 5981.326 


3.32E-6 4.14E-5 

9.77E-5 9.60E-7 

9.42E-5 


For baseline BC: 


AX = -13,599.164 
AF= -5328.975 
AZ= -5997.821 


5.91E-6 -1.89E-7 

9.27E-5 2.51E-6 

9.54E-5 


9.29E-5 
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For baseline CD: 


AX = 22,419.481 2.31E-4 5.14E-6 2.91E-6 

AY= -12,710.949 2.32E-4 6.09E-6 

AZ = 2842.330 2.40E-4 

For baseline DE: 


AX= -4259.360 2.43E-5 3.24E-7 
A Y= -4517.252 2.45E-5 

AZ= -2822.612 


1.15E-7 

1.03E-6 

2.48E-5 


For baseline EA: 


AX = -8794.318 5.88E-5 6.38E-7 
A Y= 8302.247 5.73E-5 

AZ= -3.227 


1.65E-6 

1.02E-6 

5.87E-5 


For baseline CE: 


AZ= 18,160.142 2.16E-4 5.32E-6 2.74E-6 
AF=-17,228.164 2.11E-4 1.1 IE—5 

AZ= 19.716 2.14E-4 


17.18 Repeat Problem 17.17 with the following additional baseline vector 
observations. For EA: 


AX= -8794.307 
A F= 8302.247 
AZ= -3.233 


5.90E-5 1.08E-6 -5.39E-6 

5.61E-5 2.43E-6 

5.80E-5 


For baseline ED: 


AX = 4259.358 2.49E-5 4.38E-7 
A Y= 4517.246 2.49E-5 

A Z = 2822.605 


6.03E-7 

-3.19E-8 

2.46E-5 


For baseline AC: (Do not use in adjustment) 


AX = —9365.823 8.80E-5 1.81E-5 1.15E-6 

A F= 8925.943 6.44E-5 9.46E-8 

AZ= -16.508 6.55E-5 
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17.19 Using the data from Problems 17.17 and 17.18 with estimated setup 
error of = ±1.0 mm and a manufacturer’s estimated static survey accu¬ 
racy of 5 mm + 1 ppm analyze the following observations at a 99% level 
of confidence. 

(a) Loop ABCA. 

(b) Loop ACE A. 

(c) Loop CDEC. 

(d) Repeat baselines EA. 

(e) Repeat baselines DE and ED. 

(f) Fixed baseline AC. 

17.20 Given the following GNSS observations and geocentric control station 
coordinates to Figure PI7.20, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted stations? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

(d) the adjusted geodetic coordinates for the stations? 



Control Stations 

ID 

X(m) 

y (m) 

Z (m) 

A 

-2,408,843.951 

-3,766,414.748 

4,534,152.298 

C 

-2,409,355.162 

-3,765,292.295 

4,534,760.702 
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All the data were collected with only two receivers and the vector 
covariance matrices for the AX, A Y, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX= 62.600 
A F = 590.153 
AZ = 35.955 


1.01E-5 1.01E-6 4.31E-6 

9.86E-6 2.08E-7 

9.99E-6 


For baseline BC\ 


AX = -573.806 1.02E-5 

A F= 532.297 
A Z = 572.451 


1.75E-7 5.00E-7 

1.00E-5 3.23E-7 

9.98E-6 


For baseline CD: 


AX = -281.658 9.98E-6 4.87E-8 
AF=-507.897 1.01E-5 

AZ = -572.446 


2.79E-7 

4.62E-7 

1.02E-5 


For baseline DE: 


AX= 192.913 
AY = -555.113 
AZ= -33.420 


1.00E-5 2.01E-7 2.76E-7 

9.56E-6 3.28E-7 

9.78E-6 


For baseline EA: 


L\X= -0.100 
A F= -59.446 
AZ= -2.541 


1.00E-5 2.99E-7 -1.16E-7 

9.71E-6 2.15E-7 

9.85E-6 


For baseline FB: 


AX = 445.908 
A F= -204.416 
AZ= -377.022 


1.01E-5 5.06E-7 -1.08E-7 

1.01E-5 5.84E-7 

9.92E-6 


For baseline EC: 


AX = -127.899 9.55E-6 1.14E-8 
A F= 327.881 9.85E-6 

AZ= 195.429 


-1.29E-6 

4.20E-7 

9.99E-6 
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For baseline FD: 


AX = -409.554 
A Y= -180.018 
AZ= -377.014 


1.00E-5 4.13E-7 4.52E-7 

1.01E-5 7.26E-7 

1.00E-5 


For baseline FE: 


AX = 383.417 1.07E-5 

AF= -735.120 
AZ= -410.433 


1.61 E—7 1.27E-7 

1.00E-5 4.46E-7 

1.02E-5 


For baseline EB: 


AX = 62.501 
AF= 530.708 
AZ= 33.415 


1.53E-5 4.96E-7 -2.91E-7 

1.02E-5 -1.57E-7 

1.01E-5 


For baseline DE\ 


AX = 792.961 
AF= -555.107 
AZ= -33.418 


1.02E-5 3.03E-7 2.37E-6 

1.03E-5 4.73E-7 

1.01E-5 


For baseline DC\ 


AX = 281.655 
A F= 507.904 
AZ= 572.446 


1.00E-5 4.99E-8 -2.20E-7 

1.00E-5 3.91E-8 

9.81E-6 


17.21 The baselines in Problem 17.20 where observed with GNSS instru¬ 
ments having manufacturer’s specified accuracies for static surveys of 
3 mm + 0.5 ppm. The user estimated the setup error as ±1.5 mm. 
Analyze: 

(a) the loop DEFD. 

(b) the loop DFCD. 

(c) the loop BCFB. 

(d) the loop BFEB. 

(e) the loop ABE A. 

(f) repeat baseline DE. 

(g) repeat baselines CD and DC. 
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17.22 Given the following GNSS observations and geocentric control station 
coordinates to Figure PI7.22, what are: 

(a) the most probable coordinates and their standard deviations for 
the adjusted stations? 

(b) the adjusted baseline vector components and their residuals? 

(c) the standard deviation of unit weight? 

(d) the adjusted geodetic coordinates for the stations? 



FIGURE P17.22 


Control Stations 

ID 

X (m) 

F(m) 

Z(m) 

A 

1,659,858.133 

4,412,163.817 

4,282,198.830 

C 

1,659,393.372 

4,411,659.134 

4,282,897.823 


All the data were collected with only two receivers and the vector 
covariance matrices for the AX, A Y, and AZ values (in meters) given 
are as follows. For baseline AB: 


AX = —311.800 9.87E-6 

A F= -332.533 
AT. — 471.908 


-6.93E-8 4.66E-6 

9.69E-6 3.32E-8 

1.00E-5 


For baseline BC\ 


AX= -152.967 
A F= -172.144 
A Z= 227.085 


3.88E-7 3.98E-8 

9.85E-6 1.18E-7 

9.46E-6 


9.76E-6 
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For baseline CD: 


AX = 767.556 
A Y= -576.316 
A Z= 292.488 


1.00E-5 -1.05E-8 —1.11 E—7 

9.89E-6 4.74E-7 

1.04E-5 


For baseline DE: 


AX = 389.379 
AF= 416.670 
AZ= -586.677 


1.00E-5 -2.05E-7 7.77E-8 

1.03E-5 2.43E-7 

9.97E-6 


For baseline EF: 


AX= 143.851 
AF = 157.243 
AZ= -213.978 


9.95E-6 1.73E-7 9.47E-8 

9.76E-6 6.78E-10 

9.85E-6 


For baseline FA: 


AX= -836.012 
AF= 507.100 
AZ= -190.831 


1.01E-5 2.57E-7 -5.85E-8 

1.05E-5 5.71E-7 

9.85E-6 


For baseline AF: 


AX= 836.015 9.59E-6 

A F= -507.099 
A Z= 190.833 


-8.57E-8 

1.03E-5 


-1.17E-6 

4.69E-7 

1.04E-5 


For baseline AE: 


AX= 692.162 9.98E-6 

AF= -664.340 
A Z= 404.808 


9.88E-8 

1.07E-5 


1.21E-7 

8.03E-7 

1.02E-5 


For baseline EB: 


AZ=-1003.969 1.16E-5 3.28E-6 3.30E-7 
A F= 331.796 1.08E-5 3.40E-7 

A Z= 67.100 1.05E-5 
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For baseline EC: 


AX= -1156.925 
A Y= 159.648 
A Z= 294.188 


1.22E-5 4.14E-7 -1.62E-7 

1.02E-5 -4.71E-7 

9.88E-6 


For baseline ED: 


AX= -389.380 
AF= -416.664 
A Z= 586.679 


1.00E-5 2.51E-7 2.27E-6 

1.04E-5 -1.48E-8 

9.95E-6 


17.23 


17.24 

17.25 

17.26 

17.27 

17.28 

17.29 


The baselines in Problem 17.22 where observed with GNSS instru¬ 
ments having manufacturer’s specified accuracies for static surveys of 
3 mm + 0.5 ppm. The user estimated the setup error as ±1.5 mm. 
Analyze the following at a 99% level of confidence. 

(a) Loop AEFA. 

(b) Loop ABEA. 

(c) Loop BCEB. 

(d) Loop CDEC. 

(e) Repeat baselines DE and ED. 

(f) Repeat baselines FA and AF. 

Use the ADJUST program to do the following problems. 

Problem 17.9. 

Problem 17.12. 

Problem 17.15. 

Problem 17.18. 

Problem 17.20. 

Problem 17.22. 


PROGRAMMING PROBLEMS 

17.30 Write a computational package that reads a hie of station coordinates 
and GNSS baselines and then 

(a) Writes the data to a hie in a formatted fashion. 

(b) Computes the A, L, and W matrices. 

(c) Writes the matrices to a hie that is compatible with the MATRIX 
program. 

(d) Demonstrate this program with Problem 17.22. 
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17.31 Write a computational package that reads a file of station coordinates 

and GPS baselines and then 

(a) Writes the data to a hie in a formatted fashion. 

(b) Computes the A, L , and W matrices. 

(c) Performs a weighted least squares adjustment. 

(d) Writes the matrices used in computations in a formatted fashion 
to a hie. 

(e) Computes the final station coordinates, their estimated errors, the 
adjusted baseline vectors, their residuals, and their estimated errors, 
and writes them to a hie in a formatted fashion. 

(f) Demonstrate this program with Problem 17.22. 


CHAPTER 18 


COORDINATE TRANSFORMATIONS 


18.1 INTRODUCTION 

The transformation of points from one coordinate system to another is a 
common problem encountered in surveying and mapping. For instance, a 
surveyor who works initially in an assumed coordinate system on a project 
may find it necessary to transform the coordinates to the state plane coordinate 
system. In GNSS surveying and in photogrammetry, coordinate transforma¬ 
tions are used extensively. Since the inception of the North American Datum of 
1983 (NAD 83), many land surveyors, management agencies, state departments 
of transportation, and others struggled with the problem of converting their 
multitudes of stations defined in the 1927 datum (NAD 27) to the 1983 datum. 
Although several mathematical models have been developed to make these 
conversions, all involve some form of coordinate transformation. This chapter 
covers the introductory procedures of using least squares to compute several 
well-known and often used transformations. More rigorous procedures, which 
employ the general least squares procedure, are given in Chapter 22. 


18.2 THE TWO-DIMENSIONAL CONFORMAL COORDINATE 

The two-dimensional conformal coordinate transformation, also known 
as the four-parameter similarity transformation, has the characteristic that 
true shape is retained after transformation. It is used typically in surveying 


389 

Adjustment Computations: Spatial Data Analysis, Sixth Edition. Charles D. Ghilani. 

© 2018 by John Wiley & Sons, Inc. Published 2018 by John Wiley & Sons, Inc. 




390 COORDINATE TRANSFORMATIONS 

when converting separate surveys into a common reference coordinate system. 
An example of this is the procedure used by several commercial software 
packages to convert satellite-derived coordinates into a local reference frame. 
For example, this procedure can be used to convert GNSS-derived WGS 
84 coordinates into one of the realizations in the NAD 83 coordinate system. 
This process, known as localization, is discussed further in Section 24.5. 
The two-dimensional conformal coordinate transformation can be thought of 
as a three-step process: 

1. Scaling to create equal dimensions in the two coordinate systems. 

2. Rotation to make the reference axes of the two systems parallel. 

3. Translations to create a common origin for the two coordinate systems. 

The scaling and rotation are each defined by one parameter. The transla¬ 
tions involve two parameters. Thus, there are a total of four parameters in 
this transformation. The transformation requires a minimum of two points, 
called control points, which are common to both systems. With the minimum 
of two points, the four parameters of the transformation can be determined 
uniquely. If more than two control points are available, a least squares 
adjustment is possible. After determining values for the transformation 
parameters, any points in the original system can be transformed into the 
second system. 


18.3 EQUATION DEVELOPMENT 

Figure 18.1(a) and ( b ) illustrates two independent coordinate systems. In these 
systems, three common control points, A, B , and C exist (i.e., their coordinates 
are known in both systems). Points 1 through 4 have coordinates known only in 
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FIGURE 18.1 Two-dimensional coordinate systems. 
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the xy system of Figure 18.1 (ft). The problem is to determine XY coordinates in 
the system of Figure 18.1(a). The necessary equations are developed as follows: 


Step 1: Scaling. To make line lengths as defined by the xy coordinate system 
equal to their lengths in the XY system, it is necessary to multiply xy 
coordinates by a scale factor, S. Thus, the scaled coordinates x' and y' 
are 


x' = Sx 
/ = Sy 


(18.1) 


Step 2: Rotation. In Figure 18.2, the XY coordinate system has been 
superimposed on the scaled x'y' system. The rotation angle, 9, is shown 
between the y' and Y axes. To analyze the effects of this rotation, an X Y 
system is constructed parallel to the XY system such that its origin is 
common with that of the x'y' system. Expressions that give the ( X , Y) 
rotated coordinates for any point (such as point 4 shown) in terms of its 
x'y' coordinates are 

X' = x' cos 6 — y' sin 9 

(18.2) 

Y' = x' sin 9 + y' cos 9 

Step 3: Translation. To finally arrive at XY coordinates for a point, it is nec¬ 
essary to translate the origin of the X Y system to the origin of the XY 
system. Referring to Figure 18.2, it can be seen that this translation is 
accomplished by adding translation factors as follows: 

X = X' + T x and Y=Y' + T y (18.3) 



FIGURE 18.2 Superimposed coordinate systems. 
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If Equations (18.1), (18.2), and (18.3) are combined, a single set of 
equations results that transform the points of Figure 18.1(h) directly into 
Figure 18.1(a) as 


X = (S cos 9)x - (S sin 8)y + T x 
Y = (S sin 9)x + (5 cos 9)y + T Y 


(18.4) 


Now letting S cos 9 = a, S sin 9 = b, T x = c, and T Y = d and adding resid¬ 
uals to make redundant equations consistent, the resulting equation can be 
written as 


ax — by + c = X + v x 
bx + ay + d = Y + v Y 


(18.5) 


18.4 APPLICATION OF LEAST SQUARES 


Equations (18.5) represent the basic observation equations for a two- 
dimensional conformal coordinate transformation that have four unknowns: 
a, b, c, and d. The four unknowns embody the transformation parameters .S', 
<9, T x , and T Y . Since two equations can be written for every control point, 
only two control points are needed for a unique solution. When more than 
two are present, a redundant system exists for which a least squares solution 
can be found. As an example, consider the equations that could be written for 
the situation illustrated in Figure 18.1. There are three control points, A, 5, 
and C, and thus the following six equations can be written 


ax a -by a + c = X A + v Xj 
bx a + ay a + d = Y A + v Yj 
ax b ~ by h + c = X b + v Xb 
bx h + ay h +d= Y B + v Yb 
ax c -by c + c = X c + v Xc 
bx c + ay c + d = Y c + v Yc 

Equations (18.6) can be expressed in matrix form as 

AX=L+V 


(18.6) 


(18.7) 


where 



-y a 
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0 

y a 

x a 

0 

1 
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-yb 

i 
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1 
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The redundant system of equations is solved using Equation (11.32). Having 
obtained the most probable values for the coefficients from the least squares 
solution, the XY coordinates for any additional points whose coordinates are 
known in the xy system are obtained by applying Equations (18.5) (where the 
residuals are now considered to be zeros). 

After the adjustment, the scale factor S and rotation angle 6 are computed 
with the following equations. 


6 = tan 1 



5 = 


a 

cos 6 


(18.8) 


Example 18.1 A survey conducted in an arbitrary xy coordinate system pro¬ 
duced station coordinates for A , B , and C as well as for stations 1 through 4. 
Stations A, B , and C also have known state plane coordinates, labeled E 
and N. It is required to derive the state plane coordinates of stations 1 
through 4. Table 18.1 has a tabulation of the arbitrary coordinates and state 
plane coordinates. 


TABLE 18.1 Data for Example 18.1 


Point 

E 

N 

X 

y 

A 

1,049,422.40 

51,089.20 

121.622 

-128.066 

B 

1,049,413.95 

49,659.30 

141.228 

187.718 

C 

1,049,244.95 

49,884.95 

175.802 

135.728 

1 



174.148 

-120.262 

2 



513.520 

-192.130 

3 



754.444 

- 67.706 

4 



972.788 

120.994 


SOLUTION A computer listing from the program ADJUST is given below. 
The data hie shown in Figure 18.3 can be found on the companion website 
for this book as Example 18-1. dat. The hist line of the hie is an explanatory 
description of the hie. Following this line is the number of common points in 
the hie. This line is followed by the control points, which in this hie are the 
E and N coordinates. The control points are followed by the points in the arbi¬ 
trary hie. All of the lines with coordinates have the format of point identiher, 
x, y, S x , S Y where the standard deviations S x and S v are optional, and the 
point identifiers are limited to 10 characters. As with all ADJUST data hies, 
the identifiers cannot contain the data delimiters of a space, comma, or tab. 
The identihers entered as pt A will be read as two separate point identifiers of 
pt and A. The software will notify the user of this as a reading error. 
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Survey transformation 
3 

A 1049422.40 51089.20 0.05 0.05 
B 1049413.95 49659.30 0.05 0.05 
C 1049244.95 49884.95 0.05 0.05 
A 121.622 -128.066 0.005 0.005 
B 141.228 187.718 0.005 0.005 
C 175.802 135.728 0.005 0.005 

1 174.148 -120.262 0.005 0.005 

2 513.52 -192.13 0.005 0.005 

3 754.444 -67.706 

4 972.788 120.994 

5 1068.118 161.624 

FIGURE 18.3 ADJUST data file for Example 18.1. 


The output includes the input data, the coordinates of transformed points, 
the transformation coefficients, and their estimated errors. Note that the 
program formed the A and L matrices in accordance with Equation (18.7). 
After obtaining the solution using Equation (11.32), the program solved 
Equation (18.8) to obtain the rotation angle and scale factor of the transfor¬ 
mation. Furthermore, this adjustment is also performed in the spreadsheet file 
Chapter 18.xls, which is available on the companion website. The Mathcad file 
C18.xmcd is available on the companion website for those wishing to program 
this problem in a higher-level computer language. 


Two Dimensional Conformal Coordinate Transformation 


ax - by + Tx = X + VX 
bx + ay + Ty = Y + VY 


A matrix L matrix 


121.622 

128.066 

1.000 

0.000 

1049422.400 

128.066 

121.622 

0.000 

1.000 

51089.200 

141.228 

-187.718 

1.000 

0.000 

1049413.950 

187.718 

141.228 

0.000 

1.000 

49659.300 

175.802 

-135.728 

1.000 

0.000 

1049244.950 

135.728 

175.802 

0.000 

1.000 

49884.950 


Transformed Control Points 

POINT X Y VX VY 


A 1,049,422.400 51,089.200 -0.004 0.029 
B 1,049,413.950 49,659.300 -0.101 0.077 
C 1,049,244.950 49,884.950 0.105 -0.106 
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Transformation Parameters: 

a = -4.51249 ± 0.00058 

b = -0.25371 ± 0.00058 

Tx = 1050003.715 ± 0.123 

Ty = 50542.131 ± 0.123 

Rotation = 183° 13' 05.0" 

Scale = 4.51962 

Adjustment’s Reference Variance = 0.0195 
Transformed Points 


POINT 

X 

Y 

±<tX 

±<ry 

1 

1,049,187.361 

51,040.629 

0.135 

0.135 

2 

1,047,637.713 

51,278.829 

0.271 

0.271 

3 

1,046,582.113 

50,656.241 

0.368 

0.368 

4 

1,045,644.713 

49,749.336 

0.484 

0.484 


18.5 TWO-DIMENSIONAL AFFINE COORDINATE 
TRANSFORMATION 


The two-dimensional affine coordinate transformation is also known 
as the six-parameter transformation. It is a slight variation from the 
two-dimensional conformal transformation. In the affine transformation 
there is the additional allowance for two different scale factors; one in the 
x direction and the other in the y direction. This transformation is commonly 
used in photogrammetry for interior orientation. That is, it is used to transform 
photo coordinates from an arbitrary measurement photo coordinate system 
to the camera fiducial coordinate system, and thus account for the differential 
shrinkages that can occur in the x and y directions. As in the conformal 
transformation, the affine transformation also applies two translations of 
the origin, and a rotation about the origin, plus a small nonorthogonality 
correction between the x and y axes. This results in a total of six unknowns. 
The observation equations for the affine transformation are 


ax + by + c = X + v x 
dx + ey +/ = Y + v Y 


(18.9) 


These equations are linear and can be solved uniquely when three control 
points exist since each control point results in an equation set in the form 
of Equations (18.9). Thus, three points yield six equations involving six 
unknowns. If more than three control points are available, a least squares 
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solution can be obtained. Assume, for example, that four common points 
(1, 2, 3, and 4) exist. Then the equation system would be 

ax\ + by i + c = X x + v x 
dx i + ey x +/ = Y\ + v Yx 
ax 2 + by 2 + c = X 2 + v Xl 
dx 2 + ey 2 +/ = Y 2 + v y 

(18.10) 

ax 2 + by 3 + c = X 2 + 

<i.x 3 + ey 2 +/ = T 3 + Vy 3 
a.\' 4 + + c = X 4 + v y 4 

f/a ‘ 4 + ey 4 + / — T 4 + Vy 4 

In matrix notation. Equations (18.10) are expressed as AX = L + V where 


"*1 

y i 

1 

0 

0 

O' 





v x 

0 

0 

0 

A'l 

y i 

1 


a 





*2 

J2 

1 

0 

0 

0 


b 


*2 



0 

0 

0 

x 2 

T2 

1 


c 


Y 2 

_1_ 


x 3 

k3 

1 

0 

0 

0 


d 


x 2 

1 


0 

0 

0 

*3 

T3 

1 


e 


Y, 


v v 3 

x 4 

k4 

1 

0 

0 

0 


f 


x 4 


v x 4 

0 

0 

0 

x 4 

>’4 

1 




LI 4 J 


V y 
r 4_ 


(18.11) 


The most probable values for the unknown parameters are computed using 
least squares Equation (11.32). They are then used to transfer the remaining 
points from the xy coordinate system to the XY coordinate system. The two 
different rotations and scale factors can be computed from these parameters 
as follows: 

Rotation of the measurement system, 0:0 = tan -1 —- 

e 

Let t be: t = tan -1 — 
a 

Nonorthogonality of the measurement axes, a: a = 0 + t 


Scale in x, S x 
Scale in y, S 


: S r 


a- 


■S y = e 


cos a 
cos t 
cos a 


cos t 
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Example 18.2 Photo coordinates, which have been measured using a digitizer, 
must be transformed into the camera’s fiducial coordinate system. The four 
fiducial points and the additional points were observed in the digitizer’s xy 
coordinate system and are listed in Table 18.2, together with the known camera 
XY fiducial coordinates. 


TABLE 18.2 Coordinates of Points for Example 18.2 


Point 

X 

Y 

% 

y 

A 

A 

1 

-113.000 

0.003 

0.764 

5.960 

0.104 

0.112 

3 

0.001 

112.993 

5.062 

10.541 

0.096 

0.120 

5 

112.998 

0.003 

9.663 

6.243 

0.112 

0.088 

7 

0.001 

-112.999 

5.350 

1.654 

0.096 

0.104 

306 



1.746 

9.354 



307 



5.329 

9.463 




SOLUTION A self-explanatory computer solution from the program 
ADJUST that yields the least squares solution for an affine transformation 
is shown below. The data file Example 18-2.dat that generated this listing 
can be found on the companion website for this book. This hie follows the 
same format as described in the solution of Example 18.1. Furthermore, 
this adjustment is also performed in the spreadsheet hie Chapter 18.xls also 
available on the companion website. The Mathcad hie C18.xmcd is available 
on the companion website for those wishing to program this problem in a 
higher-level computer language. 

Two Dimensional Affine Coordinate Transformation 


ax + by + c = X + VX 
dx + ey + f = Y + VY 

A matrix L matrix 


0 . 

.764 

5. 

.960 

1 . 

.000 

0 . 

.000 

0 . 

.000 

0 . 

.000 

-113 

.000 

0 . 

.000 

0 . 

.000 

0 . 

.000 

0 . 

.764 

5. 

.960 

1 . 

.000 

0 

.003 

5. 

.062 

10. 

.541 

1 . 

.000 

0 . 

.000 

0 . 

.000 

0 . 

.000 

0 

.001 

0 . 

.000 

0 . 

.000 

0 . 

.000 

5. 

.062 

10. 

. 541 

1 . 

.000 

112 

.993 

9. 

.663 

6. 

.243 

1 . 

.000 

0 . 

.000 

0 . 

.000 

0 . 

.000 

112 

.998 

0 . 

.000 

0 . 

.000 

0 . 

.000 

9. 

.663 

6. 

.243 

1 . 

.000 

0 

.003 

5. 

.350 

1 . 

.654 

1 . 

.000 

0 . 

.000 

0 . 

.000 

0 . 

.000 

0 

.001 

0 . 

.000 

0 . 

.000 

0 . 

.000 

5. 

.350 

1 . 

.654 

1 . 

.000 

112 

.999 
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Transformed Control Points 


POINT 

X 

Y 

VX 

VY 

1 

-113.000 

0.003 

0.101 

0.049 

3 

0.001 

112.993 

-0.086 

-0.057 

5 

112.998 

0.003 

0.117 

0.030 

7 

0.001 

-112.999 

-0.086 

-0.043 

T ransformation 

Parameters: 




a = 25.37152 ± 0.02532 

b = 0.82220 ± 0.02256 




c = -137. 

183 ± 0.203 




d = -0.80994 ± 0.02335 

e = 25.40166 ± 0.02622 




f = -150. 

723 ± 0.216 




Adjustment’s Reference Variance = 2. 

1828 


Transformed Points 




POINT 

X 

Y 

±(7X 

±(jy 

1 

-112.899 

0.052 

0.132 

0.141 

3 

-0.085 

112.936 

0.125 

0.147 

5 

113.115 

0.033 

0.139 

0.118 

7 

-0.085 

-113.042 

0.125 

0.134 

306 

-85.193 

85.470 

0.134 

0.154 

307 

5.803 

85.337 

0.107 

0.123 


18.6 THE TWO-DIMENSIONAL PROJECTIVE COORDINATE 
TRANSFORMATION 


The two-dimensional projective coordinate transformation is also 
known as the eight-parameter transformation. It is appropriate to use when 
one two-dimensional coordinate system is projected onto another nonparallel 
system. This transformation is commonly used in photogrammetry and can 
also be used to transform NAD 27 coordinates into the NAD 83 system. 
In their final form, the two-dimensional projective coordinate observation 
equations are 


a^x + byy + c 
a 2 x + b 2 y + 1 
a 2 x + b 2 y + c 
a 2 x + byy + 1 


(18.12) 


Upon inspection, it can be seen that these equations are similar to the affine 
transformation. In fact, if a 3 and b 3 are equal to zero, these equations are the 







18.6 THE TWO-DIMENSIONAL PROJECTIVE COORDINATE TRANSFORMATION 399 


affine transformation. With eight unknowns, this transformation requires a 
minimum of four control points. If there are more than four control points, the 
least squares solution may be used. Since these are nonlinear equations, they 
must be linearized and solved using Equation (11.37) or (11.39). The linearized 
form of these equations is 


-1 

O 

V ) o 

)o 

0 

0 0 

(~) 

\ da 3 7 0 

1- 

o 

TO I ^5 

1- 

O 

0 

0 

(-) 

\da 2 /0 

\ 6*2/0 \ dc i/0 

O 

^1 Q 

1 'TS 

1 

o 

TO | ro 


da x 

db x 

dc x 

da 2 

db 2 

dc 2 

da 3 

db 3 


X-X, 
Y- Yn 


(18.13) 


where 


dX 

x dX 


y 

dX 1 


da x 

a 3 x + b 2 + 1 db x 

a 3 x 

+ b 3 

+ 1 dc x a 3 x + b 3 

+ 1 

dY 

x dY 


y 

dY 1 


da 2 

a 2 x + 63 + I db 2 

a 3 x 

+ b 3 

+ 1 dc 2 a 3 x + b 3 

+ 1 

dX _ 

a x x + b x y + c. 

dX 


a x x + b x y + C] 


da 3 

(a 3 x + b 3 + l ) 2 

db 3 


(a 3 x + b 3 + 


dY 

a 0 x + b 1 y + c 1 

dY 


a 2 x + b 2 y + c 2 


da 3 

- - -x 

(a 3 x + b 3 + l ) 2 

db 3 


- V 

(a 3 .v + b 3 + l) 2 ’ 



For each control point, a set of equations of the form in Equation (18.13) 
can be written. A redundant system of equations can be solved by least 
squares to yield the eight unknown parameters. With these values, the remain¬ 
ing points in the xy coordinate system are transformed into the XY system 
using Equation (18.12). 


Example 18.3 Given the data in Table 18.3, determine the best-fit projective 
transformation parameters, and use them to transform the remaining points 
into the XY coordinate system. Program ADJUST was used to solve this 
problem and the results follow. Its data file follows the same format as 
described in the solution of Example 18.1. The data file Example 18-3.dat that 
generated this listing can be found on the companion website for this book. 
Furthermore, this adjustment is also performed in the spreadsheet file Chapter 
18.xls, which is also available on the companion website. The Mathcad file 
C18.xmcd is available on the companion website for those wishing to program 
this problem in a higher-level computer language. 
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TABLE 18.3 Data for Example 18.3 


Point 

X 

Y 

X 

y 

5, 

S, 

1 

1420.407 

895.362 

90.0 

90.0 

0.3 

0.3 

2 

895.887 

351.398 

50.0 

40.0 

0.3 

0.3 

3 

-944.926 

641.434 

-30.0 

20.0 

0.3 

0.3 

4 

968.084 

-1384.138 

50.0 

-40.0 

0.3 

0.3 

5 

1993.262 

-2367.511 

110.0 

-80.0 

0.3 

0.3 

6 

-3382.284 

3487.762 

-100.0 

80.0 

0.3 

0.3 

7 



-60.0 

20.0 

0.3 

0.3 

8 



-100.0 

-100.0 

0.3 

0.3 


Two Dimensional Projective Coordinate Transformation of File 
alx + bly + cl 

- = X + VX 

a3x + b3y + 1 

a2x + b2y + c2 

- = y + VY 

a3x + b3y + 1 

Transformation Parameters: 


al = 

25.00274 

± 

0.01538 

bl = 

0.80064 

± 

0.01896 

cl = 

-134.715 

± 

0.377 

a2 = 

-8.00771 

± 

0.00954 

b2 = 

24.99811 

± 

0.01350 

c2 = 

-149.815 

± 

0.398 

a3 = 

0.00400 

± 

0.00001 

b3 = 

0.00200 

± 

0.00001 


Adjustment’s Reference Variance = 3.8888 
Number of Iterations = 2 
Transformed Control Points 


POINT 

X 

Y 

VX 

VY 

1 

1,420.165 

895.444 

-0.242 

0.082 

2 

896.316 

351.296 

0.429 

-0.102 

3 

-944.323 

641.710 

0.603 

0.276 

4 

967.345 

-1,384.079 

-0.739 

0.059 

5 

1,993.461 

-2,367.676 

0.199 

-0.165 

6 

-3,382.534 

3,487.612 

-0.250 

-0.150 
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Transformed Points 

POINT X Y ±<rx ±ay 


1 

1,420. 

.165 

895. 

.444 

0 . 

.511 

0 . 

.549 

2 

896. 

.316 

351. 

.296 

0 . 

.465 

0 . 

.458 

3 

-944. 

.323 

641. 

.710 

0 . 

.439 

0 . 

.438 

4 

967. 

.345 

-1,384. 

.079 

0 . 

.360 

0 . 

.388 

5 

1,993. 

.461 

-2,367. 

.676 

0 . 

.482 

0 . 

.494 

6 

-3,382. 

.534 

3,487. 

.612 

0 . 

.558 

0 . 

.563 

7 

-2,023. 

.678 

1,038. 

.310 

1 . 

.717 

0 . 

.602 

8 

-6,794. 

.740 

-4,626. 

.976 

51. 

.225 

34. 

.647 


18.7 THREE-DIMENSIONAL CONFORMAL COORDINATE 
TRANSFORMATION 

The three-dimensional conformal coordinate transformation is also 
known as the seven-parameter similarity transformation. It transfers points 
from one three-dimensional coordinate system to another. It is applied in 
the process of reducing data from GNSS surveys and is also used extensively 
in photogrammetry and laser scanning. The three-dimensional conformal 
coordinate transformation involves seven parameters, three rotations, three 
translations, and one scale factor. The rotation matrix is developed from three 
consecutive two-dimensional rotations about the x, y, and z axes, respectively. 
Given in sequence, these are as follows. 

In Figure 18.4, the rotation 9 X about the x axis expressed in matrix form is 

T, = R x X ,o ( a) 

where 



Xi 


l 

0 

0 



T, = 

y i 

Ri = 

0 

cos 9 l 

sin 9 X 

II 

y 


_ z i_ 


0 

- sin (9| 

cos 9 X 


z 
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FIGURE 18.5 G 2 rotation. 

In Figure 18.5, the rotation 0 2 about the y axis expressed in matrix form is 

X 2 = R 2 X } (b) 

where 



x 2 


COS 6*2 

0 

- sin 0 2 

K> 

II 

yi 

and R 2 = 

0 

1 

0 


.“2. 


sin 0 2 

0 

cos 0 2 


In Figure 18.6, the rotation 0 2 about the z axis expressed in matrix form is 

X = R 3 X 2 (c) 

where 



~X 


cos 0 3 

sin 0 3 

O' 

X = 

Y 

and R 3 = 

— sin 0 3 

cos 0 3 

0 


Z 


0 

0 

1 
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Substituting (a) into ( b ) and in turn into (c) yields 


X = R,R 2 R x X q = RX 0 


(d) 


The three matrices R 3 , R 2 , and in (d), when multiplied together develop a 
single rotation matrix R for the transformation whose individual elements are 


where 


'll 

r n 

r l3 

21 

r 23 

>23 

'31 

r 32 

r 33 


r n = cos 6 2 cos 

r ]2 = sin 0 1 sin 9 2 cos 0 3 + cos 9 l sin 0 3 
r 13 = - cos 9 X sin 9 2 cos 0 3 + sin 0 1 sin 9 3 
r 21 = - cos 9 2 sin 0 3 

y 22 = - sin 9 j sin 9 2 sin 0 3 + cos 0 t cos 0 3 
r 23 = cos 9 X sin 9 2 sin 0 3 + sin 9 X cos 9 3 
>31 = sin 6» 2 
r 32 = - sin 9 l cos 0 2 
r 33 = cos 6>! cos 0 2 


(18.14) 


Since the rotation matrix is orthogonal, it has the property that its inverse 
is equal to its transpose. Using this property and multiplying the terms of the 
matrix X by a scale factor, S, and adding translations factors T x , T , and T z to 
translate to a common origin yields the following mathematical model for the 
transformation 

X = S(y u x + r 21 j + r 31 z) + Tx 

Y = S(r l2 x + r 22 y + r 32 z) + Ty (18.15) 

Y = S(r u x + r 23 y + r 33 z) + Tz 


Equations (18.15) involve seven unknowns ( S, 9 { , 9 2 , 9 3 , Tx, Ty, Tz). For a 
unique solution, seven equations must be written. This requires a minimum 
of two control stations with known XY coordinates and also xy coordinates, 
plus three stations with known Z and z coordinates. If there is more than 
the minimum number of control points, a least squares solution can be 
used. Equations (18.15) are nonlinear in their unknowns, and thus must be 
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linearized for a solution. The following linearized observation equations can 
be written for each point as 


( —) 0 ( —) ( —) 1 0 0 

{as Jo \deJo \dej 0 

f —) ( —) ( — ) ( — ) 0 1 0 

\dSJo \d9Jo \m 2 Jo \MiJo 

fdz\ (dz\ fdz\ (dz\ Q Q ! 

\<>S Jo V d 6 1 )o \M 2 Jo V ds 3 )0 


dS ' 
d0 x 

2 

d0 3 

dTx 

dTy 

dTz 


X-Xo 

Z-Z n 


(18.16) 


where 

dX 


dY 


— = r u x + r 2l y + r 31 z — = r u x + r 22 y + r n z 
dZ 


dS 


= r n x + r 23 y + r x z 


dY 

de x 

dX 

d0 2 


dZ 


— = -S[r u x + r 23 y + r 33 z] — = S[r 12 x + r 22 j + r 32 z] 


= S(-x sin 0 2 cos 0 3 + y sin 0 2 sin 0 3 + z cos 0 2 ) 


dY . . 

-= S(x sin 0, cos 0o cos 0%- y sin 0, cos 0o sin 0 3 + z sin 0 X sin 6b) 

d0 2 

dZ 

-= S(—x cos 0 X cos 0-, cos 0 3 + y cos 0 X cos 0 2 sin 0 3 - z cos 0 X sin 0 2 ) 

d0 2 

= S(r 2l x - r n y ) = S(r 22 x - r n y ) = S(r 23 x - r X3 y ) 


Example 18.4 The three-dimensional xi’z coordinates were observed for six 
points. Four of these points (1, 2, 3, and 4) were control points whose coor¬ 
dinates were also known in the XYZ control system. The data are shown in 
Table 18.4. Compute the parameters of a three-dimensional conformal coor¬ 
dinate transformation and use them to transform points 5 and 6 in the XYZ 
system. 


SOLUTION The results from the program ADJUST are presented below. 
The data hie that generated this listing is shown in Figure 18.7. It can be found 
on the companion website for this book with the name Example 18-4.dat. 
Similar to the other hies described in this chapter, the first line of the hie is a 
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TABLE 18.4 Data for a Three-Dimensional Conformal Coordinate Transformation 


Point X Y Z x±S x y ± S y z ± S z 


1 

2 

3 

4 

5 

6 


10,037.81 5262.09 772.04 
10,956.68 5128.17 783.00 
8780.08 4840.29 782.62 
10,185.80 4700.21 851.32 


1094.883 ± 0.007 820.085 
503.891 ± 0.011 1598.698 
2349.343 ± 0.006 207.658 
1395.320 ± 0.005 1348.853 
265.346 ± 0.005 1003.470 
784.081 ± 0.006 512.683 


± 0.008 109.821 ±0.005 
± 0.008 117.685 ±0.009 
± 0.005 151.387 ±0.007 
± 0.008 215.261 ±0.009 
± 0.007 78.609 ± 0.003 
± 0.008 139.551 ±0.008 


Example 18.4 
4 4 

1 10037.81 5262.09 

2 10956.68 5128.17 

3 8780.08 4840.29 

4 10185.80 4700.21 

1 772.04 

2 783.00 

3 782 .{52 

4 851.32 

1 1094.883 820.085 109.821 0.007 0.008 0.005 

2 503.891 1598.698 117.685 0.011 0.008 0.009 

3 2349.343 207.658 151.387 0.006 0.005 0.007 

4 1395.320 1348.853 215.261 0.005 0.008 0.009 

5 265.346 1003.470 78.609 0.005 0.007 0.003 

6 784.081 512.683 139.551 0.006 0.008 0.008 

FIGURE 18.7 ADJUST data file for Example 18.4. 


description of its contents. This is followed by a line containing the number 
of horizontal and vertical control points. Since horizontal and vertical control 
points can be different, the horizontal control points are listed immediately 
following the second line. Similar to the other files described in this chapter 
these lines contain the point identifier, x, and y coordinates. Their coordinates 
may also be followed by their standard deviations, but standard deviations 
for these points are optional since they are not used in this adjustment; 
however, they will be used in the method of general least squares described 
in Chapter 22. The horizontal control points are followed by the vertical 
control points, which are then followed by the common points in the arbitrary 
coordinate system. The points in the arbitrary coordinate system have the 
format of point identifier, x, y, z, S x , S , and S z where the standard deviations 
are optional. Furthermore, the Mathcad file C18.xmcd is available on the 
companion website for those wishing to program this problem in a higher-level 
computer language. 
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3D Coordinate Transformation 




3 

matrix 




K matrix 

0.000 

102.452 

1284.788 

1.000 

0.000 

0.000 

-206.164 

- 0.000 

51.103 

-7.815 

-195.197 

0.000 

1.000 

0.000 

-1355.718 

0.000 

1287.912 

195.697 

4.553 

0.000 

0.000 

1.000 

53.794 

0.000 

0.000 

118.747 

1418.158 

1.000 

0.000 

0.000 

761.082 

- 0.000 

62.063 

28.850 

723.004 

0.000 

1.000 

0.000 

-1496.689 

- 0.000 

1421.832 

-722.441 

42.501 

0.000 

0.000 

1.000 

65.331 

- 0.000 

0.000 

129.863 

1706.020 

1.000 

0.000 

0.000 

-1530.174 

0.060 

61.683 

-58.003 

-1451.826 

0.000 

1.000 

0.000 

-1799.945 

0.209 

1709.922 

1452.485 

-41.580 

0.000 

0.000 

1.000 

64.931 

0.000 

0.000 

204.044 

1842.981 

1.000 

0.000 

0.000 

-50.417 

0.033 

130.341 

-1.911 

-46.604 

0.000 

1.000 

0.000 

-1947.124 

-0.053 

1849.740 

47.857 

15.851 

0.000 

0.000 

1.000 

137.203 

0.043 


X matrix 

0.0000347107 

0.0000103312 

0.0001056763 

0.1953458986 

0.0209088384 

0.0400969773 

0.0000257795 


Measured Points 


NAME 

X 

y 


Z 

Sx 

Sy 

Sz 

1 

1094.883 

820.085 

109 

.821 

0.007 

0.008 

0.005 

2 

503.891 

1598.698 

117 

.685 

0.011 

0.008 

0.009 

3 

2349.343 

207.658 

151 

.387 

0.006 

0.005 

0.007 

4 

1395.320 

1348.853 

215 

.261 

0.005 

0.008 

0.009 

CONTROL 

POINTS 







NAME 

X 

VX 


Y 

VY 

z 

VZ 

1 

10037.810 

0.064 

5262. 

090 

0.037 

772.040 

0.001 

2 

10956.680 

0.025 

5128. 

170 - 

-0.057 

783.000 

0.011 

3 

8780.080 

-0.007 

4840. 

290 - 

-0.028 

782.620 

0.007 

4 

10185.800 

-0.033 

4700. 

210 

0.091 

851.320 

-0.024 


Transformation Coefficients 


Scale = 

0.94996 

+/- 0.00004 

x-rot = 

2°17'05.3" 

+/- 0° 00' 30. V 

Y-rot = 

-0°S3'02.8 

+/- 0° 00' 09.7 

Z-rot = 

224°32'10.9 

+/- 0° 00' 06.9 

Tx = 

10233.858 

+/- 0.065 

Ty = 

6549.981 +/- 0.071 

Tz = 

720.897 

+/- 0.213 
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Reference Standard Deviation: 8.663 
Degrees of Freedom: 5 
Iterations: 2 

Transformed Coordinates 


IE 

X 

Sx 

Y 

Sy 

Z 

Sz 

1 

10037.874 

0.032 

5262.127 

0.034 

772.041 

0.040 

2 

10956.705 

0.053 

5128.113 

0.052 

783.011 

0.056 

3 

8780.073 

0.049 

4840.262 

0.041 

782.627 

0.057 

4 

10185.767 

0.032 

4700.301 

0.037 

851.296 

0.067 

5 

10722.020 

0.053 

5691.221 

0.053 

766.068 

0.088 

6 

10043.246 

0.040 

5675.898 

0.042 

816.867 

0.092 


Note that in this adjustment, with four control points available having X, Y, 
and Z coordinates, 12 equations could be written, three for each point. With 
seven unknown parameters, this gave 12 - 7 = 5 degrees of freedom in the 
solution. 


18.8 STATISTICALLY VALID PARAMETERS 

Besides the coordinate transformations described in preceding sections, 
it is possible to develop numerous others. For example, polynomial equations 
of various degrees could be used to transform data. As additional terms are 
added to a polynomial, the resulting equation will force better fits on any given 
set of data. Flowever, caution should be exercised when doing this since the 
resulting transformation parameters may not be statistically significant. 

As an example, when using a two-dimensional conformal coordinate 
transformation with a data set having four control points, nonzero residuals 
would be expected. Flowever, if a projective transformation were used, this 
data set would yield a unique solution, and thus the residuals would be zero. 
Is the projective a more appropriate transformation for this data set? Is this 
truly a better ht? Guidance in the answers to these questions can be obtained 
by checking the statistical validity of the derived parameters. 

The adjusted parameters divided by their standard deviations represent a t 
statistic with v degrees of freedom. If a parameter is to be judged as statistically 
different from zero, and thus significant, the computed t value (the test statistic) 
must be greater than t a j 2v . Simply stated, the test statistic is 


t 


Iparameteij 


(18.17) 


5 
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For example in the adjustment in of Example 18.2, the following computed 
t values are found 


Parameter 

S 

t value 

a = 25.37152 

±0.02532 

1002.0 

b = 0.82220 

±0.02256 

36.4 

c = -137.183 

±0.203 

675.8 

d= -0.80994 

±0.02335 

34.7 

e = 25.40166 

±0.02622 

968.8 

/= -150.723 

±0.216 

697.8 


In this problem, there were eight equations involving six unknowns and thus 
two degrees of freedom. From the t distribution table (Table D.3), / 0 . 02 S ,2 = 
4.303. Because all computed t values are greater than 4.303, each parameter is 
significantly different from zero at a 95% level of confidence. From the adjust¬ 
ment results of Example 18.3, the computed t values are listed below. 


Parameters 

Value 

V 

t value 

«i 

25.00274 

0.01538 

1626.0 

b] 

0.80064 

0.01896 

42.3 

U 

-134.715 

0.377 

357.3 

a 2 

-8.00771 

0.00954 

839.4 

b 2 

24.99811 

0.01350 

1851.7 

c 2 

-149.815 

0.398 

376.4 

a 3 

0.00400 

0.00001 

400.0 


0.00200 

0.00002 

100.0 


This adjustment has eight unknown parameters and 12 observations. From 
the /-distribution table (Table D.3), / 0 . 025,4 = 2.776. By comparing the tabular t 
value against each computed value, all parameters are significantly different 
from zero at a 95% confidence level. This is true for a 2 and b 3 even though they 
seem relatively small at 0.004 and 0.002, respectively. 

Using this statistical technique, a check can be made to determine whether 
the projective transformation is appropriate for a particular set of data since 
it will default to an affine transformation when a 3 and b 3 are both statistically 
equal to zero. Similarly if the confidence intervals for the means of a and b 
at a selected probability level of the two-dimensional conformal coordinate 
transformation contain two of the parameters from the affine transformation, 
then the computed values of the affine transformation are statistically the 
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equal to those from the conformal transformation. Thus, if the interval for 
the population mean of a from the conformal transformation contains both a 
and e parameters from the affine transformation, then there is no statistical 
difference between these parameters. This must also be true for the population 
mean of b from the conformal transformation when compared to absolute 
values of b and d from the affine transformation. Note that a negative sign is 
part of the mathematical model for the conformal coordinate transformation, 
and thus b and d parameters are opposite in signs typically. If both of these 
conditions exist, then conformal transformation is the more appropriate 
adjustment to use for the given data since it involves fewer parameters and 
provides more redundant observations. One should always use the minimum 
number of unknown parameters to solve any problem. 

A statistical test can be performed to check the parameters individually 
against their respective conformal-transformation parameters. This test 
assumes that the sample data come from populations having the same vari¬ 
ance. Since, in this example, the same data are being used, this assumption is 
valid. A two-tailed test should be used. The test setup is 


Ho- (hi — Pi) — 0 
H a : (hi - p 2 ) f 0 


Test statistic: 


Jl -J2 


is 2 


1 1 

«| « 2 


where S 2 


y l s 2 + v 2 s 2 2 

Vi + v 2 


Rejection region: |/j > ,, where v = v l + v 2 


Example 18.5 A two-dimensional conformal coordinate transformation 
was run on the data from Example 18.2. Compare the parameters from the 
two-dimensional conformal coordinate transformation against their equiva¬ 
lent parameters from the two-dimensional affine coordinate transformation to 
determine the most appropriate transformation for this set of data. 


SOLUTION The results of the two-dimensional conformal coordinate trans¬ 
formation are presented here: 


Parameter 

Value 

5 

A 

25.36443 

0.01435 

B 

-0.81531 

0.1892 

Tx 

-137.185 

0.180 

Ty 

-150.477 

0.165 
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These results are compared with the results of the affine coordinate 
transformation, which was listed earlier in this section. If any of the param¬ 
eters from the affine transformation are different statistically from the 
conformal transformation, then the affine transformation is the appropriate 
mathematical model for the data. However, if none of the parameters are 
different, then the conformal coordinate transformation mathematical model 
is the more appropriate mathematical model for the set of data. 

Method 1: The 95% confidence interval is developed for the population 
mean based on the values of a and b from the conformal coordinate 
transformation. In this approach, if the equivalent pair of parameters 
from the affine coordinate transformation is contained inside the range 
for the population mean, then the conformal coordinate transformation 
is the appropriate mathematical model. If any of the parameters from 
the affine transformation fall outside their respective ranges, then the 
affine transformation should be used. Using Equation (4.7), at 95% level, 
the population ranges are: 

For a: 25.36443 ± t 00254 — = (25.3503,25.3785) 

' Vs 

For b: - 0.81531 ± /b 0254 Q - 01892 = (-0.83388,-0.79674) 

Vs 

When comparing the affine transformation parameters of a and e, we see 
that e with a value of 25.40166 is outside the 95% confidence interval for the 
population mean of a from the conformal coordinate transformation. Thus, 
since one parameter is outside the interval, the affine transformation is the most 
appropriate mathematical model for the data. This is true even though b and d 
from the affine transformation are inside their respective range. It should be 
remembered that the mathematical model for the conformal coordinate trans¬ 
formation incorporates the sign differences in these parameters. 

Method 2: In this method, each of the four parameters from the affine 
transformation must be tested for a statistical difference from the mean 
of the respective conformal coordinate parameters. It should be noted 
that the conformal coordinate transformation for this problem has four 
redundant observations (8 - 4), the affine coordinate transformation 
only has two redundant observations (8 - 6) since both adjustments use 
the same eight observations. To check e from the affine transformation 
against a from the conformal coordinate transformation, the following 
test is constructed. 



Ho- (Mi — M 2 ) — 0 
H a : (m\ ~ M2) # 0 
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Test statistic: S 2 


t = 


4(0.01435 2 ) + 2(0.02622 2 ) 
= 4T2 

|25.36443-25.40166| 


0.00036644 


= 3.89 


0.00036644 


(r4) 


Rejection region: 3.89 > 2.45 = i 0 . 025,6 (true) 

Since the rejection region is true, we can reject the hypothesis that the two 
means are the same. Thus, the affine coordinate transformation is the most 
appropriate mathematical model for this set of data. This test should be per¬ 
formed on the other three parameters. However, there is no further need to do 
this since e has already determined that the affine transformation is appropriate 
for this set of data. 


PROBLEMS 

Note: For problems requiring least squares adjustment, if a computer program 
is not distinctly specified for use in the problem, it is expected that the least 
squares algorithm will be solved using the program MATRIX, which is avail¬ 
able on the book’s companion website. Partial answers to problems marked 
with an asterisk are given in Appendix H. 

18.1 Points A, B , C, and D have their coordinates known in both an XY 
system and a xy system. Points E and Fhave their coordinates known 
only in the xy system. These coordinates are shown in the table below. 
Using a two-dimensional conformal coordinate transformation, 
determine the 

*(a) Transformation parameters and their standard deviations. 

(b) Most probable coordinates and their standard deviations for 
E and Fin the XY coordinate system. 

*(c) Rotation angle and scale factor. 
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Point 

Control Points 


Observed Points 


X 

Y 

X 

y 

s x 


A 

-112.442 

-112.113 

-59.510 

-147.214 

0.0028 

0.0024 

B 

-112.485 

112.082 

-147.366 

59.037 

0.0029 

0.0027 

C 

112.398 

112.097 

59.522 

147.143 

0.0027 

0.0026 

D 

112.102 

-112.436 

147.206 

-59.555 

0.0025 

0.0025 

E 



-102.284 

-46.885 

0.0024 

0.0025 

F 



-43.765 

103.186 

0.0029 

0.0025 


18.2 Points A, B , C, and D have their coordinates known in both a (X, Y) 
coordinate system and an arbitrary (x, y) system. Points E , F, and G 
have their coordinates known only in the xy system. These coordinates 
are shown in the following table. Using a two-dimensional conformal 
coordinate transformation, determine the 

(a) transformation parameters and their standard deviations. 

(b) most probable coordinates and their standard deviations for E , F, 
and G in the XY coordinate system. 

(c) rotation angle and scale factor. 


Point 

Control Points 


Observed Points 


X 

Y 


y 

5, 

s. 

A 

1766.755 

1060.632 

1692.046 

1174.951 

0.0462 

0.0481 

B 

707.177 

707.090 

622.726 

816.501 

0.0462 

0.0503 

C 

1060.714 

1767.799 

980.701 

1886.112 

0.0484 

0.0472 

D 

1414.180 

1414.228 

1336.870 

1530.531 

0.0637 

0.0476 

E 



566.519 

1172.078 

0.0462 

0.0503 

F 



1423.505 

1617.175 

0.0462 

0.0503 

G 



1334.658 

1250.912 

0.0484 

0.0472 


18.3 Repeat Problem 18.1 parts a and b using a two-dimensional affine coor¬ 
dinate transformation. Determine if all the parameters are statistically 
significant at a 5% level of significance, and use Method 1 to determine 
if the affine transformation is significantly different from the conformal 
transformation used in Problem 18.1 at a 0.05 level of significance. 

18.4 Repeat Problem 18.3 with the data from Problem 18.2, but use 
Method 2 to determine if the transformations are statistically different. 
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18.5 Using a two-dimensional projective coordinate transformation and the 
data listed below, determine the 
*(a) transformation parameters. 

(b) most probable coordinates for 9 and 10 in the XY coordinate 
system. 


Point 

Observed Points 

Control Points 


y 

X 

Y 

1 

177.562 ±0.010 

-39.647 ± 0.009 

-106.005 

-105.902 

2 

138.835 ±0.010 

35.597 ±0.010 

105.995 

106.154 

3 

-69.851 ±0.010 

-531.386 ±0.010 

-105.965 

105.940 

4 

44.499 + 0.013 

-108.903 ±0.010 

105.696 

-105.990 

5 

90.823 ±0.011 

-201.408 ±0.010 

-112.005 

-0.026 

6 

97.382 ±0.011 

-29.917 ±0.010 

111.940 

-0.110 

7 

217.344 ±0.010 

242.207 ± 0.010 

0.065 

112.090 

8 

-198.417 ±0.010 

-254.362 ± 0.009 

-0.006 

-111.993 

9 

168.454 ±0.010 

132.710 ±0.009 



10 

225.533 ±0.010 

-347.645 ± 0.009 




18.6 Do Problem 18.5 using a two-dimensional affine coordinate transfor¬ 
mation. Determine the 

(a) transformation parameters. 

(b) most probable coordinates for 9 and 10 in the XY coordinate 
system. 

18.7 Do Problem 18.5 using a two-dimensional conformal coordinate trans¬ 
formation. Determine the 

*(a) transformation parameters. 

(b) most probable coordinates for 9 and 10 in the XY coordinate 
system. 

* 18.8 Determine the appropriate two-dimensional transformation for 
Problem 18.5 at a 0.01 level of significance. 

18.9 Using a two-dimensional affine coordinate transformation and the 
following data, determine the 

(a) transformation parameters and their standard deviations. 

(b) most probable XY coordinates and their standard deviations for 
points 9 and 10. 
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Point 

X 

y 

X 

Y 

1 

110.299 ±0.030 

223.770 ± 0.020 

-113.0003 

0.0024 

2 

189.312 ±0.031 

318.053 ±0.027 

-105.9607 

105.5976 

3 

284.184 ±0.029 

397.601 ± 0.027 

0.0021 

112.9936 

4 

369.095 ± 0.033 

464.989 ± 0.028 

105.9974 

105.9964 

5 

301.569 ±0.038 

380.021 ±0.031 

112.8857 

-0.0031 

6 

222.348 ± 0.039 

285.493 ± 0.027 

105.8891 

-105.9349 

7 

127.803 ± 0.025 

206.276 ± 0.030 

-0.0015 

-112.9843 

8 

43.234 ± 0.034 

139.272 ±0.024 

-105.8870 

-105.6290 

9 

60.902 ± 0.026 

153.553 ±0.022 



10 

191.255 ±0.031 

274.046 ± 0.042 




18.10 Using a two-dimensional projective coordinate transformation, do 
Problem 18.9. Determine the 

(a) transformation parameters. 

(b) most probable coordinates for 9 and 10 in the XY coordinate 
system. 

18.11 For the data of Problem 18.9, which two-dimensional transformation 
is most appropriate, and why? Use a 0.01 level of significance. 

18.12 Determine the appropriate two-dimensional coordinate transfor¬ 
mation for the following data at a 0.01 level of significance when 
transforming the XY coordinates into the EN coordinate system. 


Point 

E{ m) 

N (m) 

X (mm) 

Y (mm) 

S x (mm) 

S y (mm) 

1 

291,360.253 

241,034.672 

89.747 

91.006 

±0.005 

±0.005 

2 

307,234.546 

210,935.117 

39.967 

0.014 

±0.006 

±0.005 

3 

296,293.531 

194,422.039 

-20.410 

0.031 

±0.006 

±0.005 

4 

320,061.348 

206,453.166 

50.161 

-40.125 

±0.005 

±0.005 

5 

341,823.531 

215,435.048 

109.608 

-80.316 

±0.006 

±0.005 

6 

259,874.536 

186,836.945 

-100.971 

79.819 

±0.005 

±0.006 


18.13 A survey is connected to a map projection through five stations yielding 
the following data. 

(a) Using Method 2, determine whether the two-dimensional transfor¬ 
mation should be conformal or affine. 
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(b) Using the appropriate transformation, determine the map projec¬ 
tion coordinates for stations 6 and 7. 


Station 

E{ m) 

7V(m) 

^ (ft) 

Y (ft) 

s x (ft) 

S y (ft) 

1 

297,095.673 

447,714.614 

5,122.06 

10,989.68 

±0.024 

±0.032 

2 

297,634.665 

449,032.907 

5,494.73 

6,332.02 

±0.023 

±0.032 

3 

296,089.372 

449,935.376 

11,355.01 

5,976.37 

±0.033 

±0.029 

4 

294,887.784 

450,236.082 

15,318.28 

6,874.03 

±0.034 

±0.027 

5 

294,776.577 

449,077.555 

13,929.50 

10,430.82 

±0.032 

±0.024 

6 



8,865.20 

8,466.09 

±0.028 

±0.033 

7 



10,449.35 

8,330.68 

±0.030 

±0.031 

18.14 

Using a level of significance of 0.01, which two-dimensional adjustment 


is appropriate for the following set of data? 




Point 

X 

Y 

X 

y 

S x 

S, 

1 

286.94 

153.23 

1.484 

1.530 

0.044 

0.046 

2 

299.94 

162.98 

10.556 

5.936 

0.052 

0.053 

3 

291.48 

164.11 

1.641 

10.558 

0.052 

0.041 

4 

296.81 

166.21 

6.014 

10.468 

0.055 

0.045 

5 

302.18 

168.41 

10.591 

10.386 

0.051 

0.043 

6 

299.95 

162.98 

10.490 

5.908 

0.053 

0.049 

7 

297.66 

157.53 

10.390 

1.555 

0.053 

0.051 


18.15 

Repeat Problem 18.14 with the following set of data. 


Point 

X 

Y 

X 

y 


Sy 

1 

215.83 

62.48 

88.998 

92.996 

±0.008 

±0.007 

2 

127.71 

32.27 

56.011 

41.997 

±0.010 

±0.009 

3 

9.62 

97.75 

-30.991 

28.005 

±0.008 

±0.008 

4 

43.92 

-69.54 

53.995 

-43.997 

±0.008 

±0.007 

5 

64.60 

-187.12 

112.014 

-96.009 

±0.007 

±0.008 

6 

-21.61 

239.23 

-103.999 

87.992 

±0.007 

±0.008 

7 

-168.60 

-0.11 

-83.004 

-93.987 

±0.008 

±0.010 
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18.16 Using a weighted three-dimensional conformal coordinate transfor¬ 
mation determine the transformation parameters and their standard 
deviations for the following data set. 


Control Points 


Point 

E (m) 

7V(m) 

H( m) 

1 

205,164.469 

304,594.279 

704.854 

2 

206,136.407 

304,465.336 

801.905 

3 

203,844.790 

304,119.963 

734.595 

4 

205,375.205 

303,969.042 

826.081 

5 

206,259.276 

304,204.779 

765.483 


Measured Points 

Point 

e(m) 

n (m) 

h (m) 

S x (m) 

S y (m) 

S, (m) 

1 

1094.961 

810.073 

804.720 

0.030 

0.031 

0.033 

2 

508.350 

1595.668 

901.727 

0.033 

0.032 

0.029 

3 

2356.262 

197.087 

834.482 

0.033 

0.032 

0.035 

4 

1395.162 

1397.651 

925.925 

0.029 

0.034 

0.037 

5 

608.992 

1865.577 

865.380 

0.034 

0.031 

0.033 


18.17 Using a weighted three-dimensional conformal coordinate transforma¬ 
tion and the follow set of data, determine the 

(a) Transformation parameters and their standard deviations. 

(b) Compute the XYZ coordinates and their standard deviations for 
those points 7 and 8. 

Control Stations 

Station 

E (ft) 

N (ft) 

h (ft) 

1 

219,443.00 

368,197.08 

3,571.03 

2 

234,970.98 

384,596.81 


3 

261,702.80 

330,626.39 

4,946.57 

4 

216,837.18 

435,443.53 

2,930.39 

5 



3,114.83 
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Measured Stations 


Station 

e (m) 

n (m) 

H{m) 

S e (m) 

S n (m) 

$H ( m ) 

1 

9,845.091 

16,911.903 

1,057.279 

±0.033 

±0.029 

±0.030 

2 

16,441.120 

14,941.898 

1,169.101 

±0.030 

±0.028 

±0.033 

3 

5,433.242 

250.807 

1,476.544 

±0.024 

±0.031 

±0.030 

4 

27,781.032 

26,864.601 

861.996 

±0.032 

±0.029 

±0.029 

5 

8,543.372 

22,014.387 

1,139.236 

±0.027 

±0.036 

±0.032 

6 

4,140.043 

24,618.102 

918.231 

±0.034 

±0.032 

±0.028 

7 

23,124.965 

4,672.241 

1,351.714 

±0.028 

±0.032 

±0.029 

8 

4,893.819 

12,668.861 

1,679.214 

±0.021 

±0.032 

±0.025 


18.18 Repeat Problem 18.17 with the following data. 

Control Stations 

Station 

E{ m) 

7V(m) 

h (m) 

1 

648,310.393 

452,394.453 

170.062 

2 



131.926 

3 

645,324.766 

452,557.056 


4 

647,117.161 

453,846.222 

161.601 

5 



167.270 

6 

645,324.746 

452,556.980 



Measured Stations 

Station 

A- (ft) 

y (ft) 

H (ft) 

s x (ft) 

S y (ft) 

S H (ft) 

1 

6,019.68 

5,163.17 

210.33 

±0.033 

±0.024 

±0.033 

2 

5,901.12 

11,192.94 

85.11 

±0.029 

±0.037 

±0.030 

3 

12,591.53 

12,446.33 

120.16 

±0.033 

±0.031 

±0.030 

4 

12,184.77 

5,214.17 

182.42 

±0.031 

±0.026 

±0.029 

5 

5,901.06 

11,192.99 

201.02 

±0.030 

±0.034 

±0.032 

6 

12,591.29 

12,446.47 

153.12 

±0.020 

±0.030 

±0.029 

7 

12,184.99 

5,214.33 

95.35 

±0.027 

±0.027 

±0.030 

8 

9,728.88 

7,873.23 

132.99 

±0.027 

±0.030 

±0.029 
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Use the program ADJUST to do each problem. 

18.19 Problem 18.4. 

18.20 Problem 18.14. 

18.21 Problem 18.17. 

PROGRAMMING PROBLEMS 

Develop a computational program that calculates the coefficient and constants 
matrix for each transformation. 

18.22 A two-dimensional conformal coordinate transformation. 

18.23 A two-dimensional affine coordinate transformation. 

18.24 A two-dimensional projective coordinate transformation. 

18.25 A three-dimensional conformal coordinate transformation. 


CHAPTER 19 


ERROR ELLIPSE 


19.1 INTRODUCTION 

^3 As discussed previously, after completing a least squares adjustment, the 
estimated standard deviations in the coordinates of an adjusted station can 
be calculated from covariance matrix elements. These standard deviations pro¬ 
vide error estimates in the reference axes directions. In graphical representation, 
they are half the dimensions of a standard error rectangle centered on each sta¬ 
tion. The standard error rectangle has dimensions of 2 S x by 2 S r as illustrated 
for station B in Figure 19.1, but this is not a true representation of the error 
present at the station. 

Simple deductive reasoning can be used to show the basic problem. Assume 
in Figure 19.1 that the XY coordinates of station A have been computed from 
the observations of distance AB and azimuth Az ab , which is approximately 
30°. Further assume that the observed azimuth has no error at all, but that 
the distance has a large error, say ±2 ft. From Figure 19.1, it should then be 
readily apparent that the largest uncertainty in the station’s position would not 
lie in either cardinal direction. That is, neither S x nor S v represents the largest 
positional uncertainty for the station. Rather, the largest uncertainty would be 
collinear with line AB and approximately equal to the estimated error in the 
distance. In fact, this is what happens. 

In the usual case, the position of a station is uncertain in both direction 
and distance, and the estimated error of the adjusted station involves the errors 
of two jointly distributed variables, the x and y coordinates. Thus, the posi¬ 
tional error at a station follows a bivariate normal distribution. The general 
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-►X 

FIGURE 19.1 Standard error rectangle. 


shape of this distribution for a station is shown in Figure 19.2. In this figure, 
the three-dimensional surface plot [Figure 19.2(a)] of a bivariate normal distri¬ 
bution curve is shown along with its contour plot [Figure 19.2(6)]. Note that 
the ellipses shown in the xy plane of Figure 19.2(6) can be obtained by passing 
planes of varying levels through Figure 19.2(a) parallel to the xy plane. The 
volume of the region inside the intersection of any plane with the surface of 
Figure 19.2(a) represents the probability level of the ellipse. The orthogonal 
projection of the surface plot of Figure 19.2(a) onto the xz plane would give 
the normal distribution curve of the x coordinate, from which S x is obtained. 
Likewise, its orthogonal projection onto the yz plane would give the normal 
distribution in the y coordinate from which .S',, is obtained. 


Y 



FIGURE 19.2 (a) Three-dimensional view and (6) contour plot of a bivariate 
distribution. 
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FIGURE 19.3 Standard error ellipse. 


To fully describe the estimated error of a station, it is only necessary to show 
the orientation and lengths of the semiaxes of the error ellipse. A detailed dia¬ 
gram of an error ellipse is shown in Figure 19.3. In this figure, the standard 
error ellipse of a station is shown (i.e., one whose arcs are tangent to the sides 
of the standard error rectangle). The orientation of the ellipse depends on the 
t angle, which fixes the directions of the auxiliary, orthogonal uv axes along 
which the ellipse axes lie. The u axis defines the weakest direction in which the 
station’s adjusted position is known. In other words, it lies in the direction of 
maximum estimated error in the station’s coordinates. The v axis is orthogonal 
to u and defines the strongest direction in which the station’s position is known, 
or the direction of minimum error. For any station, the value of t that orients 
the ellipse to provide these maximum and minimum values can be determined 
after the adjustment from the elements of the covariance matrix. 

The exact probability level of the standard error ellipse is dependent on the 
number of degrees of freedom in the adjustment. This standard error ellipse 
can be modified in dimensions through the use of F critical values to represent 
an error probability at any selected percentage. It will be shown later that the 
percent probability within the boundary of standard error ellipse for a simple 
closed traverse is only 35%. Surveyors often use the 95% probability since this 
affords a higher level of confidence. 

19.2 COMPUTATION OF ELLIPSE ORIENTATION AND SEMIAXES 

As shown in Figure 19.4, the method for calculating the orientation angle t 
that yields maximum and minimum semiaxes involves a two-dimensional coor¬ 
dinate rotation. Notice that the t angle is defined as a clockwise angle from 
the y axis to the u axis. To propagate the errors in a point / from the xy sys¬ 
tem into an orthogonal uv system, the generalized law of the propagation of 
variances, discussed in Chapter 6, is used. The specific value for t that yields 
the maximum error along the u axis must be determined. The following steps 
accomplish this task. 
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FIGURE 19.4 Two-dimensional rotation. 


Step 1: Any point I in the uv system can be represented with respect to its 
XY coordinates as 


Uj = x t sin t + y f cos t 


Vj = -Xj cos t + y t sin t 


(19.1) 


Rewriting Equations (19.1) in matrix form yields 


u i 


sin t 

cos t 


x i 



- cos t 

sin t 


A 


or, in simplified matrix notation, 


Z = RX 


(19.3) 


Step 2: Assume that for the adjustment problem in which I appears, there 
is a Q xx matrix for the xy coordinate system. The problem is to develop, 
from the Q xx matrix, a new covariance matrix Q zz for the uv coordinate 
system. This can be done using the generalized law for the propagation 
of variances, given in Chapter 6 as 

2L. = S]RQ XX R J (19.4) 


where 


R = 


sin t 
- cos t 


cos t 
sin t 


Since S~ is a scalar, it can temporarily be dropped and recalled again after 
the derivation. Thus, 


Q :: = RQ xx R t 


(/uu Quv 
tfuv tfvv 


Q 


XX 


Vxx <lxy 
tfxy tfyy. 


(19.5) 


where 
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Step 3: Expanding Equation (19.5), the elements of the Q zz matrix are 


Qzz = 


q xx sm t + q xy cos t sin t 


+q sin t cos t + r/ vv cos z ? 


yy 


-q xx cos t sin t + q xy sin t 
-q cos 2 1 + q yy sin t cos t 

Q tm Q uv 
Quv 


—q xx sin t cos t - q cos 1 1 
+q xy sm 2 t + q cos t sin t 

q xx cos 2 t - q sin t cos t 
-q cos t sin t + ry vr sin 2 ? 


Step 4: The q uu element of Equation (19.6) can be rewritten as 

• 2 • 9 

q uu = q xx sm~t + 2q cos t sin t + q yv cos t 


(19.6) 


(19.7) 


The following trigonometric identities are useful in developing the equation 
for t. 


sin 2? = 2 sin? cos? 
cos It = cos t - sin"? 
cos 2 ? + sin 2 ? = 1 

Substituting identity (a) into Equation (19.7) yields 

• 2 ? - sin 2? 

<luu = <lxx sin t + q yy cos ? + 2q xy —-— 


(«) 

(b) 

(c) 


(19.8) 


Regrouping the first two terms and adding the necessary terms to 
Equation (19.8) to maintain equality yields 

9xx + 9yy f . 2 , 2a , q xx ^t q yy cos 2 t 

Quu - -t -(sin ? + cos - ?) H---1--- 


q yy sin~t q xx cos 2 t 


+ q xy sin 2? 


(19.9) 


2 2 

Substituting identity (c) and regrouping Equation (19.9) results in 

Qxx T Qyy Qyy i • 2 \ Qxx, 2 . 2 

Quu = -+ —(cos"? - sin 2 ?) - —(cos"? - sin"?) 

+ q xy sin 2? (19.10) 

Finally, substituting identity ( b ) into Equation (19.10) yields 

Qxx + Qyy Qyy- Qxx „ . „ 

Quu =- y— + —-cos 2? + q xy sin 2? 


2 


2 


(19.11) 
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TABLE 19.1 Selection of the Proper Quadrant for 2 f 


Algebraic sign of sin 2 1 

cos It 

Quadrant 

+ 

+ 

1 

+ 

- 

2 

- 

- 

3 

- 

+ 

4 


a When calculating for t, always remember to select the proper 
quadrant of 2t before dividing by 2. 


To find the value of t that maximizes q uu , differentiate q uu in Equation (19.8) 
with respect to t and set the results equal to zero. This yields 

dluu Qyy — Qxx . 

—— =---2sin2t + 2q xy cos2t = 0 (19.12) 

Reducing Equation (19.12) yields 

(q yy - q xx ) sin 2t = 2q xy cos 2t (19.13) 

Finally, rearranging Equation (19.13) yields 

^ = tan2t= 2q ' xy (19.14,) 

COS 2 t Clyy-Qxx 

Equation (19.14a) is used to compute 2 1, and hence the desired angle t 
that yields the maximum value of q uu . Note that the correct quadrant of 2 1 
must be determined by noting the sign of the numerator and denominator 
in Equation (19.14a) before dividing by 2 to obtain t. Table 19.1 shows the 
proper quadrant for the different possible sign combinations of the numerator 
and denominator. 

Table 19.1 can be avoided by using the atan2 function available in most soft¬ 
ware packages. This function returns a value between -180° <2 1 < 180°. If the 
value returned is negative, the correct value for 2 1 is obtained by adding 360°. 
The correct usage of the atan2 function in this instance is 

2 1 = atan2 (q yy - q xx ,2q xy ) (19.14 b) 

The use of Equation (19.146) is demonstrated in the Mathcad worksheet 
cl9.xmcd on the companion website. 

Correlation between the latitude and departure of a station was discussed in 
Chapter 8. Similarly, the adjusted coordinates of a station are also correlated. 
Computing the value of t that yields the maximum and minimum values for the 
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semiaxes is equivalent to rotating the covariance matrix until the off-diagonals 
are nonzero. Thus, the u and v coordinate values will be uncorrelated, which is 
equivalent to setting the q uv element of Equation (19.6) equal to zero. Using the 
trigonometric identities previously noted, the element q uv from Equation (19.6) 
can be written as 

q uv = " —— sin 2t + q xy cos 2t (19.15) 

Setting q uv equal to zero and solving for t 

i!!ia£ = , an 2«=U5i- (19.16) 

cos 2 1 q yy - q xx 

Note that this yields the same result as Equation (19.14), which verifies the 
removal of the correlation. 


Step 5: In a fashion similar to that demonstrated in Step 4, the q rr element 
of Equation (19.6) can be rewritten as 

q vv = q xx cos 2 t-2q xy cos t sin t + < 7 ^, sin 2 / (19.17) 

In summary, the t angle, semimajor axis (q uu ), and semiminor axis (q n ) of 
the error ellipse are calculated using Equations (19.14), (19.7), and (19.17), 
respectively. These equations are repeated here, in order, for convenience. Note 
that these equations use only elements from the covariance matrix particular 
to the station, which will be demonstrated by example. 

2 q 

tan 2? =-(19.18) 

9yy ~ Vxx 

q uu = q xx sin 2 t + 2 q cos t sin t + q vv cos 2 t (19.19) 

q vv = q xx cos t - 2q cos t sin t + q yy sm t (19.20) 

Equation (19.18) gives the t angle that the u axis makes with the y axis. 
Equation (19.19) yields the numerical value for q uu , which when multiplied by 
the reference variance ,S ' 2 gives the variance along the u axis. The square root of 
the variance is the semimajor axis of the standard error ellipse. Equation (19.20) 
yields the numerical value for q vv , which when multiplied by ,S ' 2 gives the vari¬ 
ance along the v axis. The square root of this variance is the semiminor 
axis of the standard error ellipse. Thus, the semimajor and semiminor 
axes are 

s u = and s v = (19.21) 
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19.3 EXAMPLE PROBLEM OF STANDARD ERROR ELLIPSE 
CALCULATIONS 

I 11 this section the error ellipse data for the trilateration example in 
Section 14.5 will be calculated. From the computer listing given for the 
solution of that problem, the following values are recalled: 


1. S,, = ±0.136 ft 

2. The unknown X and covariance Q xx matrices were 


X 


i y 

<#y\ Wi scon si n 


r/Y . 

u x Wisconsin 

dY 

Ll - /1 - Campus 

Q xx = 

rlY 

u J Campus 



1.198574 
-1.160249 

-0.099772 

-1.402250 


1.160249 -0.099772 -1.402250 
2.634937 0.193956 2.725964 
0.193956 0.583150 0.460480 
2.725964 0.460480 3.962823 


19.3.1 Error Ellipse for Station Wisconsin 

Since the coordinates for station Wisconsin are in the first two rows of the X 
matrix only the corresponding 2x2 block diagonal elements of the Q xx matrix 
are used in the computations. From these elements, the tangent of 2 1 is 


tan 2 1 = 


2(—1.160249) 
2.634937 - 1.198574 


-1.6155 


Notice that the sign of the numerator is negative and the denominator is 
positive. Thus, from Table 19.1 angle 2 1 is in the fourth quadrant, and 360° 
must be added to the computed angle. Flence, 


2 1 = tan -1 (—1.6155) = -58°14.5' + 360° = 301°45.5' 


and t = 150°53' 

Substituting the appropriate values into Equation (19.21), S u is 

S u = ±0.136^ 1.198574 sin 2 ? + 2(-1.160249) cos /sin t + 2.634937 cos 2 ? 
= ±0.25 ft 


Similarly substituting the appropriate values into Equation (19.21), S r is 

S v = ±0.136\J 1.198574 cos 2 f - 2(-1.160249) cos / sin t + 2.634937 sin 2 / 
= ±0.10 ft 









19.3 EXAMPLE PROBLEM OF STANDARD ERROR ELLIPSE CALCULATIONS 427 


The standard deviations in the coordinates, as computed by Equation 
(13.24), are 


S x = S oy /q^. = ±0.136Vl.198574 = ±0.15 ft 
S y = S oy /^, = ±0.136\/2.634937 = ±0.22 ft 

Since deriving the components of an error ellipse is an orthogonaliza- 
tion of the 2x2 block diagonal matrix for a station, this process can 
also be performed using eigenvectors and eigenvalues. This process is 
demonstrated in the Mathcad worksheet C19.xmcd on the companion 
website. For example the eigenvalues of the 2x2 block diagonal matrix 
for station Wisconsin are 0.55222 and 3.28129, respectively. Thus, S v _ ms is 
0.136V3.28129 = ±0.25 ft and S v _ wis is 0.136V0.55222 = ±0.101 ft. Simi¬ 
larly, the eigenvector associated with the U axis can be used to compute the t 
angle. Using Station Wisconsin as an example, the eigenvector associated with 
the eigenvalue of 3.28129 is [-0.48666 0.87359] T . The t angle is computed 
as t = atan(-0.487/0.874) + 180° = 150.8787°, which is the same value that 
was computed using Equation (19.18). 


19.3.2 Error Ellipse for Station Campus 


Using the same procedures as in Section 19.3.1, the error ellipse data for station 
Campus are 


The 2x2 block diagonal submatrix is Qxx = 


0.583150 0.460480 
0.460480 3.96823 


2 1 
t 


tan 1 

7037/ 


/ 2(0.460480) \ 

V 3.962823 - 0.583150 ) 


15°14' 


S u = ±0.1360.583150 siiw + 2(0.460480) cos / sin t + 3.962823 cos 2 ? 
= ±0.27 ft 

S v = ±0.136-^/0.583150 cos 2 ? - 2(0.460480) cos / sin t + 3.962823 sin 2 ? 
= ±0.10ft 

S x = = ±0.136V0.583150 

= ±0.10ft 

S y = S 0 yfq^ y = ±0.136 V3.962823 
= ±0.27 ft 













428 


ERROR ELLIPSE 



FIGURE 19.5 Graphical representation of error ellipses. 


19.3.3 Drawing the Standard Error 

To draw the error ellipses for stations Wisconsin and Campus of Figure 19.5, 
the error rectangle is first constructed by laying out the values of S x and .S', 
using a convenient scale along the x and y axes, respectively. For this example, 
an ellipse scale of 4800 times the map scale was selected. The t angle is laid off 
clockwise from the positive y axis to construct the u axis. The v axis is drawn 90° 
counterclockwise from u to form a right-handed coordinate system. The values 
of S u and .S', are laid off along the U and V axes, respectively, to locate the 
semiaxis points. Finally, as shown in Figure 19.3, the ellipse is constructed so 
that it is tangent to the error rectangle and passes through its semiaxes points. 


19.4 ANOTHER EXAMPLE PROBLEM 


In this section, the standard error ellipse for station U in the example of Section 
16.4 is calculated. For the adjustment, S 0 = ± 1.82 ft, and the X and Q xx 
matrices are 


X = 


dx u 

dy u _ 


e,v = 


Qxx 

Qxy 


Qxy 

Qyy. 


0.000532 0.000602 

0.000602 0.000838 


Error ellipse calculations are 


2 1 = tan 1 


2(0.000602) 
0.000838 - 0.000532 


75°44' 


t = 37°52' 














19.5 THE ERROR ELLIPSE CONFIDENCE LEVEL 429 



FIGURE 19.6 Graphical representation of error ellipse. 


Notice in this example that the reference variance passed the / 2 test, and 
thus, the sample variance can be considered to be simply an estimate of the 
population variance, which has a value of 1. Thus, the population variance can 
be used to compute the semiaxes of the ellipse. This is done in the following 
computations: 

S u = ± 1 \j 0.000532 shrt + 2(0.000602) cos t sin t + 0.000838 cos 2 ? 

= ±0.036 ft 

S v = ± 1 \j 0.000532 cos 2 / - 2(0.000602) cos / sin t + 0.000838 sin 2 / 

= ±0.008 ft 

S x = ± 1 \/0.000532 = ±0.023 ft 

S y = ±1 Vo.000838 = ±0.029 ft 

Figure 19.6 shows the plotted standard error ellipse and its error rectangle. 


19.5 THE ERROR ELLIPSE CONFIDENCE LEVEL 

The calculations in Sections 19.3 and 19.4 produce standard error ellipses. 
These ellipses can be modified to produce error ellipses at any confidence 
level a by using an F statistic with two numerator degrees of freedom and 
the degrees of freedom for the adjustment in the denominator. Since the 
F statistic represents a ratio of two variances having different degrees of 
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TABLE 19.2 E (aj2: d e grees of freedom) Statistics for Selected Probability Levels 


Degrees of Freedom 


Probability 


90% 

95% 

99% 

1 

49.50 

199.50 

4999.50 

2 

9.00 

19.00 

99.00 

3 

5.46 

9.55 

30.82 

4 

4.32 

6.94 

18.00 

5 

3.78 

5.79 

13.27 

10 

2.92 

4.10 

7.56 

15 

2.70 

3.68 

6.36 

20 

2.59 

3.49 

5.85 

30 

2.49 

3.32 

5.39 

60 

2.39 

3.15 

4.98 


freedom, it can be expected that with increases in the number of degrees of 
freedom there will be corresponding increases in precision. The critical value 
for degrees of freedom) modifies the probability of the error ellipse for various 
confidence levels, as listed in Table 19.2. Notice that as the degrees of freedom 
increase, the ^-statistic modifiers decrease rapidly and begin to stabilize for 
larger degrees of freedom. The confidence level of an error ellipse can be 
increased to any level by using the multiplier 


\J 2F («.2, degrees of freedom) (19.22) 

Using the following equations, the percent probability for the semimajor and 
semiminor axes can be computed as 


} u% 


= S u c = 
= S v c = 




degrees of freedom) 


degrees of freedom) 


(19.23) 


From the foregoing, it should be apparent that as the number of degrees 
of freedom (redundancies) increases, precision increases, and the size of error 
ellipse decreases. Using the techniques discussed in Chapter 4, the values listed 
in Table 19.2 are for the F distribution at 90% (a = 0.10), 95% (a = 0.05), and 
99% (a = 0.01) probability. These probabilities are those most commonly used. 
Values from this table can be substituted into Equation (19.22) to determine the 
value of c for the probability selected and the given number of redundancies in 
the adjustment. This table is for convenience only and does not contain the 
values necessary for all situations that might arise. 
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Example 19.1 Calculate the 95% error ellipse for station Wisconsin of 
Section 19.3.1. 

SOLUTION Using Equations (19.23) yields 

S U9s% = ±0.25V2(199.50) = ±4.99 ft 

S V95% = ±0.10^2(199.50) = ±2.00 ft 

S X95% = \/2( 199.50)N V = ±(19.97 x 0.15) ± 3.00ft 

S y95% = V2(199.50)S,. = ±(19.97 x 0.22) ± 4.39ft 

The probability of the standard error ellipse can be found by setting the 
multiplier 2 F a rl v2 equal to 1 so that F avlv2 = 0.5. For a simple closed traverse 
with three degrees of freedom, this means that F a 2 3 = 0.5. The value of a that 
satisfies this condition is 0.65, which was found by trial-and-error procedures 
using the program STATS. Thus, the percent probability of the standard 
error ellipse in a simple closed traverse is (1 - 0.65)100%, or 35%. The reader 
is encouraged to verify this result using program STATS. It is also left as 
an exercise for the reader to show that the percent probability for the standard 
error ellipse ranges from 35% to only 39% for horizontal surveys having less 
than 100 degrees of freedom. 


19.6 ERROR ELLIPSE ADVANTAGES 

Besides providing critical information regarding the precision of an adjusted 
station position, a major advantage of error ellipses is that they offer a method 
of making a visual comparison of the relative precisions between any two sta¬ 
tions. By viewing the shapes, sizes, and orientations of error ellipses, various 
surveys can be compared rapidly and meaningfully. 

19.6.1 Survey Network Design 

The sizes, shapes, and orientations of error ellipses are dependent on (1) the 
control used to constrain the adjustment, ( 2 ) the observational precisions, 
and (3) the geometry of the survey. The last two of these three elements are 
variables that can be altered in the design of a survey in order to produce 
optimal results. In designing surveys that involve the traditional observations 
of distances and angles, estimated precisions can be computed for observations 
made with differing combinations of equipment and held procedures. Also, 
trial variations in station placement, which creates the network geometry, can 
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be made. Then these varying combinations of observations and geometry 
can be processed through least squares adjustments and the resulting station 
error ellipses computed, plotted, and checked against the desired results. Once 
acceptable goals are achieved in this process, the observational equipment, 
held procedures, and network geometry that provide these results can be 
adopted. This overall process is called network design. It enables surveyors to 
select the equipment and held techniques, and to decide on the number and 
locations of stations that provide the highest precision at lowest cost. This can 
be done in the office using simulation software before bidding the contract or 
entering the held. 

In designing networks to be surveyed using the traditional observations of 
distance, angle, and directions, it is important to understand the relationships 
of those observations to the resulting positional uncertainties of the stations. 
The following relationships apply: 

1. Distance observations strengthen the positions of stations in directions 
collinear with the observed lines. 

2. Angle and direction observations strengthen the positions of stations in 
directions perpendicular to the lines of sight. 

A simple analysis made with reference to Figure 19.1 should clarify the 
two relationships. Assume first that the length of line AB was precisely mea¬ 
sured but its direction was not observed. Then the positional uncertainty of 
station B should be held within close tolerances by the observed distance, but 
it woidd only be held in the direction collinear with AB. The distance observa¬ 
tion would do nothing to keep line AB from rotating, and in fact the position 
of B would be weak perpendicular to AB. On the other hand, if the direction of 
AB had been observed precisely but its length had not been measured, the posi¬ 
tional strength of station B would be strongest in the direction perpendicular 
to AB. But an angle observation alone does nothing to fix distances between 
observed stations, and thus the position of station B would be weak along line 
AB. If both the length and direction AB were observed with equal precision, a 
positional uncertainty for station B that is more uniform in all directions wordd 
be expected. In a survey network that consists of many interconnected stations, 
analyzing the effects of observations is not quite as simple as was just demon¬ 
strated for the single line AB. Nevertheless, the two basic relationships stated 
still apply. 

Uniform positional strength in all directions for all stations is the desired 
goal in survey network design. This would be achieved if, following least 
squares adjustment, all error ellipses were circular in shape and of equal 
size. Although this goal is seldom possible completely, by analyzing various 
combinations of geometric figures together with different combinations of 
observations and precisions diligently, this goal can be approached. Some¬ 
times, however, other overriding factors, such as station accessibility, terrain, 
and vegetation preclude the actual use of an optimal design. 
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The network design process discussed above is aided significantly by the use 
of aerial photos and/or topographic maps. These products enable layout of trial 
station locations and permits analysis of the accessibility and intervisibility of 
these stations to be investigated. However, a field reconnaissance should be 
made before adopting a final design. 

The global navigation satellite systems (GNSS) have brought about 
dramatic changes in all areas of surveying and network design is not an 
exception. Although GNSS does require overhead visibility at each receiver 
station for tracking satellites, problems of intervisibility between ground 
stations is eliminated. Thus, networks having uniform geometry can normally 
be laid out. Because each station in the network is occupied in a GNSS survey, 
the XYZ coordinates of the stations can be determined. This simplifies the 
problem of designing networks to attain error ellipses of uniform shapes and 
sizes. Additionally, recent photogrammetric images in the area of a project 
are often available over the Internet, which make checking satellite visibility 
problems possible. However, the geometric configuration of satellites plays 
a more important role in final station precisions. The positional dilution of 
precision (PDOP) can be a guide to the geometric strength of the observed 
satellites. In this case, the lower the PDOP, the stronger the satellite geometry. 
For more discussion on designing GNSS surveys, readers are referred to books 
devoted to the subject of GNSS surveying. 

19.6.2 Example Network 

Figure 19.7 shows error ellipses for two survey networks. Figure 19.7(a) illus¬ 
trates the error ellipses from a trilateration survey with the nine stations, two of 
which (Red and Bug) were control stations. The survey includes 19 distance 
observations and 5 degrees of freedom. Figure 19.7(6) shows the error ellipses 
of the same network that was observed using triangulation and a baseline from 
stations Red to Bug. This survey includes 19 observed angles, and thus also has 
5 degrees of freedom. 

With respect to these two figures, and keeping in mind that the smaller the 
ellipse, the higher the precision, the following general observations can be 
made: 

1. In both figures, stations Sand and Birch have the highest precisions. 
This, of course, is expected due to their proximity to control station Bug, 
and because of the density of observations made to these stations, which 
included direct measurements from both control stations. 

2. The large size of error ellipses at stations Beaver, Schutt, Bunker, and 
Bee of Figure 19.7(6) show that they have lower precision. This, too, is 
expected because there were fewer observations made to those stations. 
Also, neither Beaver nor Bee was connected directly by observations to 
either of the control stations. 
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Sand 


Sand 


‘Bug 


Red 


Bunker & Bunker 


Red 


FIGURE 19.7 Network analysis using error ellipses: (a) trilateration for 19 distances; 
(b) triangulation for 19 angles. 


3. Stations White and Schutt of Figure 19.7(a) have relatively high 
East-West precisions and relatively low North-South precisions. Exam¬ 
ination of the network geometry reveals that this could be expected. 
Distance measurements to those two points from station Red, plus 
an observed distance between White and Schutt, would have greatly 
improved the North-South precision. 

4. Stations Beaver and Bunker of Figure 19.7(a) have relatively low preci¬ 
sions East-West and relatively high precisions North-South. Again, this 
is expected when examining the network geometry. 

5. The smaller error ellipses of Figure 19.7(a) suggest that the trilatera¬ 
tion survey will yield superior precision to the triangulation survey of 
Figure 19.7(h). This is expected since the distance measurements had a 
stated uncertainty of ±(5 mm + 5 ppm). In a 5000 ft distance, this yields 
an uncertainty of ±0.030 ft. To achieve the same precision, the compara¬ 
ble angle uncertainty would need to be 



The proposed instrument and field procedures for the project that yielded 
the error ellipses of Figure 19.7(h) had an expected uncertainty of only ±6". 
The ultimate design would include both observed distances and angles. 

These examples serve to illustrate the value of computing station error 
ellipses in an a priori analysis. The observations were easily and quickly made 
by a comparison of the ellipses in the two figures. Similar information would 
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have been difficult, if not impossible, to determine from standard deviations. 
By varying the survey, it is possible ultimately to find a design that provides 
optimal results in terms of meeting a uniformly acceptable precision and 
survey economy. 


19.7 OTHER MEASURES OF STATION UNCERTAINTY 

Other measures of accuracies are sometimes called for in specifications. As dis¬ 
cussed in Section 19.5, the standard error ellipse has a c-multiplier of 1.00 and 
a probability between 35% and 39%. Other common errors and probabilities 
are given in Table 19.3. 

The orthogonalization of the submatrices demonstrated in Section 19.3.1 
can be used to compute the error ellipsoids for three-dimensional coordinates 
from a GNSS adjustment or the three-dimensional geodetic network adjust¬ 
ment discussed in Chapter 23. That is, the uncertainties along the three orthog¬ 
onal axes of the error ellipsoid can be computed using eigenvalues of the 3x3 
block diagonal submatrix appropriate for each station. The common measures 
for ellipsoids are listed in Table 19.4. 

The required accuracy for a control survey depends primarily on its purpose. 
Some major factors that affect accuracy are type and condition of equipment 
used, field procedures adopted, and the experience and capabilities of personnel 
employed. In 1998, the Federal Geographic Data Committee (FGDC) pub¬ 
lished detailed standards of accuracy and specifications for data disseminated 
by the federal government. 1 The rationale for the standards was to provide a 
uniform set of standards specifying accuracies of various data capture meth¬ 
ods for control surveys along with other analog and digital representations of 
survey data such as maps. 

Table 19.5 lists the 1998 FGDC accuracy standards for control surveys. 
These standards are independent of the method of survey and based on a 95% 


TABLE 19.3 Other Measures of Two-Dimensional Positional Uncertainties 


Probability (%) 

C 

Name 

35-39 

1.00 

Standard error ellipse 

50.0 

1.18 

Circular error probable (CEP) 

63.2 

1.41 

Distance RMS (DRMS) 

86.5 

2.00 

2-sigma ellipse 

95.0 

2.45 

95% confidence level 

98.2 

2.83 

2DRMS 

98.9 

3.00 

3-sigma ellipse 


'The 1998 FGDC standards titled Geospatial Positioning Accuracy Standards can be downloaded 
at the following website: http://www.fgdc.gov/standards/standards_publications. 
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TABLE 19.4 Measures of Three-Dimensional Positional Uncertainties 


Probability (%) 

C 

Name 

19.9 

1.00 

Standard ellipsoid 

50.0 

1.53 

Spherical error probable (SEP) 

61.0 

1.73 

Mean radical spherical error (MRSE) 

73.8 

2.00 

2-sigma ellipsoid 

95.0 

2.80 

95% confidence level 

97.1 

3.00 

3-sigma ellipsoid 


TABLE 19.5 1998 FGDC Accuracy Standards: 

Horizontal, Ellipsoid Height, and Orthometric Height 

Accuracy Classifications 

95% Confidence Less Than 
or Equal To 

1 millimeters 

0.001 meters 

2 millimeters 

0.002 meters 

5 millimeters 

0.005 meters 

1 centimeters 

0.010 meters 

2 centimeters 

0.020 meters 

5 centimeters 

0.050 meters 

1 decimeters 

0.100 meters 

2 decimeters 

0.200 meters 

5 decimeters 

0.500 meters 

1 meters 

1.000 meters 

2 meters 

2.000 meters 

5 meters 

5.000 meters 

10 meters 

10.000 meters 


confidence level. In order to meet these standards, control points in the survey 
must be consistent with all other points in the geodetic control network and not 
merely those within the particular survey. This is known as network accuracy 
and requires a comparison of survey results against network values or values 
captured using more accurate survey procedures. For example, the quality of a 
map can be determined by comparing at least 20 identifiable-point coordinate 
values against the locations of these same points as determined by an optical 
or GNSS survey. 

For horizontal surveys, the accuracy standard specifies the 95% radial error 
of the survey within which the true or theoretical location of the survey point 
falls 95% of the time. As shown in Figure 19.8, the 95% radial error is always 
shorter than the semimajor axes of the 95% error ellipse. To compute the 
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FIGURE 19.8 A 95% circular error overlaying the 95% error ellipse for Station S. 


probability of the radial error for a point, a constant C is determined using the 
semimajor (S u ) and semiminor (S v ) axes of the standard error ellipse from the 
least squares adjustment as 

C = SJS U (19.24) 

Using a polynomial from Leenhouts (1985), the radial error of a point is 
approximated as 

= S u (g 0 + c h C + c l2 C 2 + 1/3 C 3 ) (19.25) 

where r is the radial error for a station, S u the semimajor axis of the standard 
error ellipse, C as defined in Equation (19.24), and coefficients q 0 through q 2 
are as listed in Table 19.6 for various probability levels. Thus, the 95% radial 
error for a station is computed as 

r 95% = 5„(1.960790 + 0.004071C + 0.114276C 2 + 0.371625C 3 ) (19.26) 

The vertical accuracy standard specifies a linear value (plus or minus) within 
which the true or theoretical location of the point falls 95% of the time. It is 
computed using the normal distribution multiplier of 1.9600 times the standard 
deviation for the elevation of the bench mark. 
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TABLE 19.6 Coefficients for a Third-Order Polynomial Approximations of Radial 
Errors 


% Probability 

% 

<h 

<h 

03 

50 

0.671956 

0.011407 

1.013704 

-0.523457 

75 

1.153896 

-0.121102 

0.925793 

-2.198069 

90 

1.647743 

-0.62698 

0.437189 

0.127667 

95 

1.960790 

0.004071 

0.114276 

0.371625 

99 

2.572111 

0.127744 

-0.394634 

0.727603 

99.5 

2.801799 

0.165577 

-0.538393 

0.821817 

99.9 

3.282670 

0.228114 

-0.767617 

0.964153 


Procedures leading to classification of a survey to these standards involve 
four steps: 

1. The survey observations, field records, sketches, and other documenta¬ 
tion are examined to ensure their compliance with specifications for the 
intended accuracy of the survey. 

2. A minimally constrained least squares adjustment of the survey observa¬ 
tions is analyzed to guarantee that the observations are free from blun¬ 
ders and have been correctly weighted. 

3. The accuracy of control points in the local existing network to which the 
survey is tied is computed by random error propagation and weighted 
accordingly in the least squares adjustment of the survey network. 

4. The survey accuracy is checked at the 95% confidence level by compar¬ 
ing minimally constrained adjustment results against established control. 
The comparison takes into account the network accuracy of the exist¬ 
ing control as well as systematic effects such as crustal motion or datum 
distortion. 

Following the adjustment, a local accuracy for the survey can be determined 
using an average 95% radial error for the station coordinates or bench marks in 
the survey. The local accuracy represents the correctness of the coordinates of 
the stations relative to the coordinates of other stations in the survey. The net¬ 
work accuracy represents the correctness of the coordinates in the survey with 
respect to the geodetic datum. Thus, it is possible that a survey may have a very 
good local accuracy but not have a good network accuracy. To understand this, 
consider a survey for an engineering project that is based on a few local control 
stations in the project area. In order to qualify for determination of network 
accuracy, the survey should be connected to 20 or more control stations in the 
geodetic datum. Since this goes beyond the scope of the survey, which may 
be supporting a construction project, these standards also have guidelines for 
architectural, engineering, construction, and facilities management projects. 
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As stated previously, these standards can also be used to classify maps, 
scanning projects, and other data capture or representation processes. These 
standards closely align with the ASPRS Accuracy Standards for Digital 
Geospatial Datar The importance of classifying the accuracy of maps with 
statistical values is that all forms of maps, whether hardcopy or digital, 
can have their accuracy stated so that users understand the product and its 
potential uses. The root mean square error (RMSE) is defined as the square 
root of the average of squared discrepancies for points tested as discussed 
in Section 2.10. Discrepancies are the differences between coordinates and 
elevations of points taken from the map, and their values as determined by 
check surveys. Mathematically, it is denoted as 


RMSE = 



[/(*<) ~ Xj? 
n 


(19.27) 


where n is the number of tested samples from the map, /(x,) is the posi¬ 
tion obtained from the map or geodetic datum, and x t is the position 
obtained from the check survey. For example, consider the data shown in 
Table 19.7. The map-derived values for coordinates of the points are shown 
in columns (1) - (3). The surveyed checkpoint coordinate values are shown in 
columns (4) - (6). The discrepancies shown in columns (7) - (9) are computed 
as the difference between the map and checkpoint coordinate values. Since the 
checkpoints must be surveyed at a higher accuracy than the map, these discrep¬ 
ancies can be thought of as residuals. Thus, the residual for the x coordinate of 
point 1 is computed as 326,064.94 - 32,069.477 = -4.537. Similarly, all other 


TABLE 19.7 Map Coordinates versus Surveyed Checkpoint Coordinates 


Point 

Map 

Coordinates 


Surveyed 

Checkpoint Coordinates 

Discrepancies/ 

Residuals 


to 

x (m) 

(2) 

y( m) 

(3) 

- ( m ) 

(4) 

X(m) 

(5) 

Y( m) 

(6) 

H(m) 

(7) 

Ax 

(8) 

A;- 

(9) 

A z 

1 

326,064.94 

27,695.00 

604.22 

326,069.477 

27,700.068 

594.056 

-4.537 

-5.068 

10.164 

2 

332,436.19 

27,596.91 

578.46 

332,438.494 

27,605.343 

587.351 

-2.304 

-8.433 

-8.891 

3 

329,244.19 

25,219.12 

585.16 

329,235.172 

25,217.616 

583.693 

9.018 

1.504 

1.467 

4 

326,054.07 

22,891.32 

558.35 

326,059.779 

22,890.734 

563.272 

-5.709 

0.586 

-4.922 

5 

332,431.37 

22,795.94 

571.03 

332,437.285 

22,796.579 

575.159 

-5.915 

-0.639 

-4.129 





Number of Checkpoints 


5 

5 

5 





RMSE (m) 



5.91 

7.76 

6.72 





RMSE r 



7.41 







95% RMSE 



12.83 


13.14 


2 The ASPRS Positional Accuracy Standards for Digital Geospatial Data can be found at 
http://www.asprs.org/wp-content/uploads/2015/01/ASPRS_Positional_Accuracy_Standards_ 
Edition l_Version 100_N ovember2014.pdf. 
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coordinate differences are determined. Using Equation (19.27), the RMSE in x 
(RMSEJ, y (RMSE y ), and z (RMSE Z ) are computed from their corresponding 
residuals as 


RMSE X 


RMSE y 


RMSE Z 


' (-4.537) 2 + (-2.304) 2 + 9.018 2 + (-5.709) 2 + (-5.915) 2 


±5.91 m 


'(-5.068) 2 + (-8.433) 2 + 1.504- + 0.586 2 + (-0.639) 2 


±4.47 m 


'(10.164)2 + (-8.891)2 + 1.467 2 + (_4.922) 2 + (-4.129) 2 


±6.72 m 


From the RMSE X and RMSE y , a radial value for the horizontal positional 
accuracy can be determined as 

RMSE r = -^RMSE^RMSE 2 = V5.91 2 ±4.47 2 = ±7.41 m 

To obtain the 95% positional horizontal accuracy for the map, the RMSE r is 
multiplied by 1.7308, which in this case results in a 95% positional horizontal 
accuracy of ±12.83 m for this map. To compute the 95% positional vertical 
accuracy for the map (RMSE Z ) is multiplied by 1.9600, which in this case yields 
±13.17 m. 

In order for RMSEs to be credible, the check survey must be performed at 
a higher level of accuracy than the map product. For example, assume a laser 
scanner is used to develop a map of a structure. In this instance, a conventional 
survey with a reflectorless total station will typically provide checkpoints at a 
higher level of accuracy and could be used to establish coordinates on clearly 
defined points, which are also visible and measured in the scan of the site. If a 
GNSS survey is to be used, special procedures as outlined in the NGS’ Guide¬ 
lines for Establishing GPS-Derived Ellipsoid Heights (Zilkoski, 1997) should 
be used to establish geodetic heights on clearly defined points. Additionally, 
the most recent geoid model must be applied to the geodetic heights to derive 
orthometric heights. Elowever, if this method is used, realize that the geoid 
model for the area of interest may contain more error than is allowable. Alter¬ 
nately, a GNSS survey could be used to establish horizontal positioning while 
differential leveling or trigonometric leveling could be used to establish ortho¬ 
metric heights on points. It should also be recognized here that the network 
accuracy of a geodetic survey can be determined using this same method, with 
check coordinates coming from network stations. 
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PROBLEMS 

Note: For problems below requiring least squares adjustment, if a computer 
program is not distinctly specified for use in the problem, it is expected that 
the least squares algorithm will be solved using the program MATRIX, which 
is included on the book’s companion website. Partial answers are provided for 
problems marked with an asterisk in Appendix H. 

* 19.1 Calculate the semiminor and semimajor axes of the standard error 
ellipse for the adjusted position of station U in the trilateration 
Example 15.1. Plot the figure using a scale of 1:10,000 and the error 
ellipse using an appropriate scale. 

* 19.2 Calculate the semiminor and semimajor axes of the 95% confidence 
error ellipse for Problem 19.1. Plot this ellipse superimposed over the 
ellipse of Problem 19.1. 

19.3 Repeat Problem 19.1 using the resection problem in Example 15.2. 

19.4 Repeat Problem 19.2 using the data for Problem 19.3. 

19.5 Same as Problem 19.1 except for the adjusted position of stations 
B and C of Example 15.3. Use a scale of 1:24,000 for the figure and 
plot the error ellipses using an appropriate multiplication factor. 
Calculate the error ellipse data for the unknown stations in each 
problem. 

* 19.6 Problem 14.1. 

19.7 Problem 14.4. 

19.8 Problem 14.8. 

19.9 Problem 15.2. 

19.10 Problem 15.5. 

19.11 Problem 15.9. 

19.12 Problem 16.1. 

19.13 Problem 16.2. 

19.14 Problem 16.3. 

19.15 Problem 16.4. 

19.16 Problem 16.5. 

19.17 Problem 16.6. 

19.18 Problem 16.7. 
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19.19 Problem 16.8. 

19.20 Problem 16.9. 

19.21 Problem 16.11. 

Using a level of significance of 0.05, compute the 95% probable error 
ellipse for the stations in each problem. 


* 19.22 

19.23 

19.24 

19.25 

19.26 

19.27 


Problem 19.12. 

Problem 19.14. 

Problem 19.17. 

Problem 19.19. 

Problem 19.20. 

Using the program STATS, determine the percent probability of the 
standard error ellipse for a horizontal survey with 
*(a) 6 degrees of freedom. 

(b) 12 degrees of freedom. 

(c) 18 degrees of freedom. 

(d) 64 degrees of freedom. 

(e) 120 degrees of freedom. 


PROGRAMMING PROBLEMS 

19.28 Develop a computational program that takes the Q xx matrix and Si 
from a horizontal adjustment and computes error ellipse data for the 
unknown stations. 

19.29 Develop a computational program that solves Problems 19.15 
and 19.16. 


CHAPTER 20 


CONSTRAINT EQUATIONS 


20.1 INTRODUCTION 

When doing an adjustment, it is sometimes necessary to fix an observation 
to a specific value. For instance, in Chapter 14, it was shown that the coor¬ 
dinates of a control station can be fixed by setting its dx and dy corrections 
to zero, and thus the corrections and their corresponding coefficients in the 
J matrix were removed from the solution. This is called a constrained adjust¬ 
ment. Another constrained adjustment occurs when the direction or length 
of a line is held to a specific value or when an elevation difference between 
two stations is fixed in differential leveling. In this chapter methods available 
for developing observational constraints are discussed. Flowever, before dis¬ 
cussing constraints, the procedure for including control station coordinates in 
an adjustment is described. 


20.2 ADJUSTMENT OF CONTROL STATION COORDINATES 

I n examples in preceding chapters when the coordinates of a control 
station were excluded from the adjustments, hence their values held fixed, 
constrained adjustments were being performed. That is, the observations were 
being forced to fit the control coordinates. Flowever, control is not perfect. 
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and not all control is of equal reliability. This fact is evidenced by the fact that 
different orders of accuracy are used to classify control. 

When more than minimal control is held fixed in an adjustment, the observa¬ 
tions are forced to fit this control. For example, if the coordinates of two control 
stations are held fixed, but their actual positions are not in agreement with 
the values given by their held coordinates, the observations will be adjusted to 
match the erroneous coordinates. Simply stated, precise observations may be 
forced to fit less precise control. This was not a major problem in the days of 
transits and tapes, but does happen with modern instrumentation. This topic 
is discussed in more detail in Chapter 21. 

To clarify the problem further, suppose that a new survey is tied to two exist¬ 
ing control stations set from two previous surveys. Assume that the precision of 
the existing control stations is only 1:10,000. A new survey uses equipment and 
held procedures designed to produce a survey of 1:50,000. Thus, it will have a 
higher accuracy than either of the control stations to which it must ht. If both 
existing control stations are fixed in the adjustment, the new observations must 
distort to ht the errors of the existing control stations. After the adjustment, 
their residuals will show a lower-order ht that matches the control. In this case, 
it would be better to allow the control coordinates to adjust according to their 
assigned quality so that the observations are not distorted. However, it should 
be stated that the precision of the new coordinates relative to stations not in 
the adjustment can only be as good as the initial control. 

The observation equations for control station coordinates are 


x' = x + v x 

/ =y + v y 


( 20 . 1 ) 


In Equation (20.1), x' and y' are the observed coordinate values of the control 
station, x and y the published coordinate values for the station, and v x and v 
the residuals for the respective published coordinate values. 

To allow the control to adjust. Equations (20.1) must be included in the 
adjustment for each control station. To fix a control station in this scheme, high 
weights are assigned to the station’s coordinates. Conversely, low weights will 
allow a control station’s coordinates to adjust. In this manner, all control sta¬ 
tions are allowed to adjust in accordance with their expected levels of accuracy. 
In Chapter 21, it will be shown that when the control is included as observa¬ 
tions, poor observations and control stations can be isolated in the adjustment 
by using weights. 


Example 20.1 A trilateration survey was completed for the network shown in 
Figure 20.1, and the following observations collected: 
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Control Stations 

Station 

A (ft) 

Y (ft) 

A 

10,000.00 

10,000.00 

C 

12,487.08 

10,528.65 


Distance Observations 


From 

To 

Distance (ft) 

a (ft) 

From 

To 

Distance (ft) 

a (ft) 

A 

B 

1400.91 

0.023 

B 

E 

1644.29 

0.023 

A 

E 

1090.55 

0.022 

B 

F 

1217.54 

0.022 

B 

C 

1723.45 

0.023 

D 

F 

842.75 

0.022 

C 

F 

976.26 

0.022 

D 

E 

1044.99 

0.022 

C 

D 

1244.40 

0.023 

E 

F 

930.93 

0.022 


Perform a least squares adjustment of this survey, holding the control coordi¬ 
nates of stations A and C by appropriate weights (Assume that these control 
stations have a precision of 1:10,000). 

SOLUTION The first iteration linearized observation equations for the con¬ 
trol coordinates of Equation (20.1) are 


dx A = 10,000.00 — x'. 
dy A = 10,000.00 -y' Ao 
dx c = 12,487.08 - x' r 
dy c = 10,528.65 - y' c 
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The J, X, and K matrices formed in this adjustment are 


j = 


'Ay.lli 

A d ab 


d!, AE 

0 

0 

0 

0 

0 

0 

0 

0 

dx A 

‘ >yx 

dx B 

ty B 

rll >AE 

<>J>AE 

0 

0 

0 

0 

0 

0 

dP A E 

ADae 

0 

0 

dx A 

Ayx 

dx E 

ty E 

0 

0 

&Dbe 

ad be 

0 

0 

0 

0 

ad be 

AD b e 

0 

0 

dx B 

Ay B 

dx E 

'>y F 

0 

0 

dD BF 

dD BF 

0 

0 

0 

0 

0 

0 

dPpF 

dPsF 

dx B 

Ay B 

dx F 

dy F 

0 

0 

dD BC 

dD BC 



0 

0 

0 

0 

0 

0 

dx B 

r ’yn 

dx c 

^yc 

0 

0 

0 

0 

dD CF 

dD CF 

0 

0 

0 

0 

dP(2p 

dP(2p 

dx c 

dy c 

dxp 

< >y r 

0 

0 

0 

0 

dD CD 

dD CD 

dDcP 

dPgp 

0 

0 

0 

0 

dx c 

•>y c 

dx D 

dy D 

0 

0 

0 

0 

0 

0 

dPpF 

dPpF 

0 

0 

dPpF 

dPp F 

dx D 

dy D 

dxp 

< >y r 

0 

0 

0 

0 

0 

0 

dPpE 

dP pe 

AD d e 

UDde 

0 

0 

dx D 

dy D 

dx E 

“y F 

0 

0 

0 

0 

0 

0 

0 

0 

dP EF 

dD EE 

dPpp 

dD EF 

dx E 

•>y F 

dxp 

<>y r 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 


x = 


dx A 

dy A 

dx B 

d y B 

dx r 


dx D 

d y D 

dx E 

dy E 

dx„ 


K = 


- AB n 


- BE„ 


- DE„ 


y a yA„ 

X,, - x r . 


Notice that the last four rows of the J matrix correspond to linearized 
observation Equation (20.1) for the coordinates of control stations A and C. 
Each coordinate has a row with one in the column corresponding to its correc¬ 
tion. Obviously, by including the control station coordinates, four unknowns 
have been added to the adjustment: dx A , dy A , dx c , and dy c . Elowever, four 
observations have also been added. Therefore, the number of redundancies 
is unaffected by adding the coordinate observation equations. That is, the 
adjustment has the same number of redundancies with or without the 
control equations. 
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It is possible to weight a control station according to the precision of 
its coordinates. Unfortunately control stations are sometimes published 
with distance precisions rather than the covariance matrix elements that are 
required for weighting. However, estimates of the standard deviations of the 
coordinates can be computed from the published distance precisions. That is, 
if the distance precision between stations A and C is 1:10,000 or better, then- 
coordinates should have estimated errors that yield a distance precision of 
1:10,000 between the stations. To find the estimated errors in the coordinates 
that yield the appropriate distance precision between the stations. Equation 
(6.16) can be applied to the distance formula, resulting in 



( dD H 

\ dx i 


a 2 + 


( dD a 

V dy t 


°y, + 



+ 


( dD U 

V ty 



( 20 . 2 ) 


In Equation (20.2), a 2 is the variance in distance Z)„ and a 2 , a 2 , a 2 , and a 2 

u ij ■> i "v yj 

the variances in the coordinates of the end points of the line. Assuming that 
the estimated errors for the coordinates of Equation (20.2) are equal and 
substituting in the appropriate partial derivatives yields 




2 

a 2 + 2 


dD ij 

dy 


= 2 



(20.3) 


In Equation (20.3), o c is the standard deviation in the x and y coordinates. 
[Note that the partial derivatives appearing in Equation (20.3) were described 
in Section 14.2.] Factoring 2<r 2 from Equation (20.3) yields 


2a; 


Ax 2 + A y 2 

l.J 2 


= 2 at 


(20.4) 


where a 2 = a 2 = a 2 . 

From the coordinates of A and C, distance AC is 2542.65 ft. To get a dis¬ 
tance precision of 1:10,000, a maximum distance error of ±0.25 ft can exist. 
Assuming equal coordinate errors, then 


±0.25 = a Y V2 = a,,\/2 
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Thus, a x = ay = ±0.18 ft. The computed standard deviations are used to weight 
the control in the adjustment. The weight matrix for this adjustment is 



0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 


0 

1 

0.022 2 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

1 

0.023 2 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 0 

0 0 

0 0 

h ° 

0 0.023 2 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 


0 

0 

0 

0 

0 

_ 1 

0.022 2 

0 

0 

0 

0 

0 

0 

0 

0 


0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

h 0 

0 si? 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 


0 

0 

0 

0 

0 

0 

0 

0 

1 

0.022 2 

0 

0 

0 

0 

0 


0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

i? 0 

0 ofe 

0 0 

0 0 

0 0 


0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

IIF 0 

0 d? 

0 0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0.18 2 


The adjustment results, obtained using the program ADJUST, are shown 
below. 


**** Adjusted Distance Observations **** 

No. | From | To | Distance | Residual | 


1 

A 

B 

1,400 

910 | 

-0 

000 | 

2 

A 

E 

1,090 

550 | 

-0 

000 | 

3 

B 

E 

1,644 

288 | 

-0 

002 | 

4 

B 

F 

1,217 

544 | 

0 

004 | 

5 

B 

C 

1,723 

447 | 

-0 

003 | 

6 

C 

F 

976 

263 | 

0 

003 | 

7 

C 

D 

1,244 

397 | 

-0 

003 | 

8 

D 

E 

1,044 

988 | 

-0 

002 | 

9 

E 

F 

930 

933 | 

0 

003 | 

10 

D 

F 

842 

753 | 

0 

003 | 


****** Adjusted Control Stations ****** 

No. | Sta. | Northing | Easting | N Res | E Res | 


1| C | 10,528.650 | 12,487.080 | 0.000 | 0.002 | 

21 A I 10,000.000 I 10,000.000 | -0.000 | -0.002 | 


Reference Standard Deviation = 0.25 
Degrees of Freedom = 2 

******* Adjusted Unknowns ****** 

Station | Northing | Easting | <y North | a East | t ang” |A axis |B axis | 


A | 10,000.000| 

B | 11,103.933| 


9,999.998| 0.033| 0.045| 168.000| 0.046| 0.033| 
10,862.483| 0.039| 0.034| 65.522| 0.040| 0.033| 
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C| 

10,528.650| 

12,487.082| 

0.033| 

0.045| 

168.000| 

0.046| 

0.033| 

D| 

9,387.462| 

11,990.882| 

0.040| 

0.038| 

49.910| 

0.044| 

0.033| 

E| 

9,461.900| 

10,948.549| 

0.039| 

0.034| 

110.4091 

0.039| 

0.033| 

F| 

10,131.563| 

11,595.223| 

0.033| 

0.034| 

17.967| 

0.034| 

0.033| 


Notice that the control stations were adjusted slightly, as evidenced by their 
residuals. Also note the error ellipse data computed for each control station. 


20.3 HOLDING CONTROL STATION COORDINATES AND 
DIRECTIONS OF LINES FIXED IN A TRILATERATION ADJUSTMENT 


As demonstrated in Example 14.1, the coordinates of a control station 
are easily fixed during an adjustment. This is accomplished by assigning val¬ 
ues of zero to the coefficients of the dx and dy correction terms. This method 
removes their corrections from the equations. In that particular example, each 
observation equation had only two unknowns, since one end of each observed 
distance was a control station that was held fixed during the adjustment. This 
was a special case of a method known as solution by elimination of constraints. 

This method can be shown in matrix notation as 


A x X x + A 2 X 2 = L x + V (20.5) 

C)X, + C 2 X 2 = L 2 (20.6) 

In Equation (20.6), A x , A 2 , X x , X 2 , L x , and L 2 are the A, X , and L matrices 
partitioned by the constraint equations, as shown in Figure 20.2; Cj and C 2 
are the partitions of the matrix C consisting of the coefficients of the constraint 
equations; and V is the residual matrix. In this method, matrices A, C, and X 
are partitioned into two matrix equations that separate the constrained and 
unconstrained observations. Careful consideration should be given to the par¬ 
tition of C x since this matrix cannot be singular. If singularity exists, a new 



FIGURE 20.2 A, X, and L matrices partitioned. 
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set of constraint equations that are mathematically independent must be deter¬ 
mined. Also, since each constraint equation will remove one parameter from 
the adjustment, the number of constraints must not be so large that the remain¬ 
ing A x and X x have no independent equations or are themselves singular. 
From Equation (20.6), solve for X x in terms of Cj, C 2 , X 2 , and L 2 as 

= Cf 1 (L 2 - C 2 X 2 ) (20.7) 

Substituting Equation (20.7) into Equation (20.5) yields 

A x [Cf 1 (L 2 - C 2 X 2 )} + A 2 X 2 = L x + V (20.8) 

Rearranging Equation (20.8), regrouping, and dropping V for the time being 
gives 

(-A 1 C 1 ~ 1 C 2 + A 2 )X 2 = L 1 -A l C 1 ~ l L 2 (20.9) 

Letting A' = -A x C x ~ l C 2 + A 2 , Equation (20.9) can be rewritten as 

A'X 2 =L x -A 1 C ] ~ 1 L 2 (20.10) 

Now Equation (20.10) can be solved for X 2 , which, in turn, is substituted into 
Equation (20.7) to solve for X x . 

It can be seen that in the solution by elimination of constraint, the con¬ 
straints equations are used to eliminate unknown parameters from the adjust¬ 
ment, thereby fixing certain geometric conditions during the adjustment. This 
method was used when the coordinates of the control stations were removed 
from the adjustments in previous chapters. In the following subsection, this 
method is used to hold the azimuth of a line during an adjustment. 

20.3.1 Holding the Direction of a Line Fixed by Elimination 
of Constraints 

Using this method constraint equations are written, and then substituted 
functionally into the observation equations to eliminate unknown parameters. 
To illustrate this, suppose that the direction of line IJ shown in Figure 20.3 is 
fixed. Thus, the position of J is constrained to move linearly along IJ during 
the adjustment. If/moves to J' after adjustment then the relationship between 
the direction of IJ and dx. and dy . is 

dxj = dy, tan a (20.11) 

For example, suppose that the direction of line AB in Figure 20.4 is to be held 
fixed during a trilateration adjustment. Noting that station A is to be held 
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FIGURE 20.3 Holding direction IJ fixed. 



FIGURE 20.4 Holding direction AB fixed in a trilateration adjustment. 


fixed and using prototype Equation (14.9), the following linearized observation 
equation results for observed distance AB. 


k, + v, 

Inh lh 


x h ~ x n yh — yn 

Dq a s Dq s a , 

-ax h H-—— ay b 


AB,. 


AB n 


( 20 . 12 ) 


Now, based on Equation (20.11), the following relationship is written for 
line AB: 


dx b = dy h tan a (20.13) 

Substituting Equation (20.13) into Equation (20.12) yields 

r — ^ a , yb 0 ~ y a , ... 

k u + v u = ABo tan a d Vb + ABo dy b (20.14) 

Factoring dy b in Equation (20.14), the constrained observation equation is 

{ x b 0 ~ x a) tan a + (y bo -y a ) 


k, + v, = 

‘■nh ‘nl 


AB n 


-dy b 


(20.15) 


Using this same method, the coefficients of dy b for lines BC and BD are also 
determined resulting in the / matrix shown in Table 20.1. 
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TABLE 20.1 The J Matrix of Figure 20.3 





Unknowns 




Distance 

dy b 

dx c 

dy c 

dx d 


dy d 

AB 

[(x b - xjtan a + 
(}’b - )’aW AB 

0 

0 

0 


0 

AC 

0 

(x c - xJIAC 

(y c -y a )IAC 

0 


0 

AD 

0 

0 

0 

(■ x d~ 

xJIAD 

( y d ~ yJ IAD 

BC 

[{x b - x c )tan a + 

(y b - y c )V B c 

(x c - x b )IBC 

(y c -y b )IBC 

0 


0 

BD 

[(x b - x rf )tan a + 

(y b -y d )]IBD 

0 

0 

(x d - 

x b )IBD 

( y d - y b )iBD 

CD 

0 

(x c - x d )l CD 

(y c -y d )!CD 

(x d ~ 

x c )!CD 

(y d -y c )ICD 


For this example the K, X, and V matrices are 


AB - AB 0 


dy b ~ 

dy c 

dx„ 


Vab 

AC - AC 0 



Vac 

AD - AD 0 

X = 

V = 

Vad 

BC — BC 0 

c 

dy d 

si x 

Vbc 

BD - BD 0 



Vbd 

CD - CDq 


CL A. / 


Vcd 


20.4 HELMERT’S METHOD 

[^21 Another method of introducing constraints was originally presented by 
Friedrich R. Flelmert in 1872. In this procedure, the constraint equation(s) bor¬ 
der the reduced normal equations as 


a t wa 

C T 

X 


~A T WL X 

c 

0 

X 


1 

K) 

1_ 


(20.16) 


To establish this matrix, the normal matrix and its matching constants matrix 
are formed, as has been done in Chapters 13 through 19. Following this, 
the observation equations for the constraints are formed. These observation 
equations are then included in the normal matrix as additional rows [C] 
and columns [ C T ] in Equation (20.16) and their constants are added to the 
constants matrix as additional rows [L 2 ] in Equation (20.16). The inverse 
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of this bordered normal matrix is computed. The matrix solution of the 
Equation (20.16) is 






-1 


X 


a t wa 

C T 


~A T WL l ~ 

X 


c 

0 


l 2 


In Equation (20.17) X 2 is not used in the subsequent solution for the unknowns. 
This procedure is illustrated in the following examples. Both Example 20.2 and 
20.3 are solved in the spreadsheet Chapter 18. xls, which is available on the 
book’s companion website. In this spreadsheet, the examples are first solved 
using Helmert’s method. Following this, they are solved using the elimina¬ 
tion of constraints method. No matter the method used, the same results are 
always obtained. 

Example 20.2 A constrained differential leveling adjustment in figure 20.5, 
differential elevations were observed for a network where the elevation 
difference between stations B and E is to be held at -17.60 ft. The elevation 
of A is 1300.62 ft and the observed elevation differences for each line are 
shown below 



Line 

From 

To 

Elevation (ft) 

•s (ft) 

1 

A 

B 

25.15 

0.07 

2 

B 

C 

-10.57 

0.05 

3 

C 

D 

-1.76 

0.03 

4 

D 

A 

-12.65 

0.08 

5 

C 

E 

-7.06 

0.03 

6 

E 

D 

5.37 

0.05 

7 

E 

A 

-7.47 

0.05 
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Perform a least squares adjustment of this level net constraining the required 
elevation difference. 


SOLUTION The A, X, and L matrices are 



1 

0 

0 o ' 





1325.77 ” 


-1 

1 

0 0 



B 

C 

D 

J7 


- 10.57 


0 

-1 

1 0 




- 1.76 

A = 

0 

0 

-1 0 


X = 

L = 

- 1313.27 


0 

-1 

0 1 




- 7.06 


0 

0 

1 -1 



£j 


5.37 


0 

0 

0 -1 





- 1308.09 

The weight matrix ( W) 

IS 







' 204.08 

0 

0 


0 

0 

0 0 



0 

400 

0 


0 

0 

0 0 



0 

0 1111.11 


0 

0 

0 0 

W = 


0 

0 

0 

156.25 

0 

0 0 



0 

0 

0 


0 

1111.11 

0 0 



0 

0 

0 


0 

0 

400 0 



0 

0 

0 


0 

0 

0 400 


The reduced normal equations are 


604.08 

-400.00 

0.00 

0.00' 

B 


'274,793.30' 

-400.00 

2622.22 

- 1111.11 

- 1111.11 

C 


5572.00 

0.00 

- 1111.11 

1667.36 

-400.00 

D 


205, 390.90 

0.00 

- 1111.11 

-400.00 

1911.11 

E 


513,243.60 


The reduced normal matrix is now bordered by the constraint equation 

E-B = -17.60 


which has a matrix form of 


[-1 0 0 1 ] 


B 

C 

D 

E 


[-17.60] 


(b) 


The left-side of Equation ( b ) is now included as an additional row and col¬ 
umn to the reduced normal matrix in Equation (a). The lower-right corner 
diagonal element of the newly bordered normal matrix is assigned a value of 0. 
Similarly, the right-hand side of Equation ( b ) is added as an additional row in 
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the right-hand side of Equation (a). Thus, the bordered-normal equations are 


' 604.80 

-400.00 

0.00 

0.00 

-1 


B 


'274,793.30' 

-400.00 

2622.22 

- 1111.11 

- 1111.11 

0 


C 


5572.00 

0.00 

- 1111.11 

1667.36 

-400.00 

0 


D 

= 

205, 390.90 

0.00 

- 1111.11 

-400.00 

1911.11 

1 


E 


513,243.60 

-1 

0 

0 

1 

0 


.* 2 . 


-17.60 


(c) 


Notice in Equation (c) that an additional unknown, X 2 , is added at the 
bottom of the X to make the X matrix dimensionally consistent with the 
bordered-normal matrix of (c). Similarly, the right-hand side of the constraint 
Equation ( b ) is added to the bottom of the matrix. Using Equation (20.17), 
the resulting solution is 


X = 


1325.686' 

1315.143 

1313.390 

1308.086 

-28.003 


(d) 


From the X matrix in Equation ( d ), elevation of station B is 1325.686 and that 
for station E is 1308.086. Thus, the elevation difference between stations B and 
E is exactly -17.60, which was required by the constraint condition. 


Example 20.3 Constraining the azimuth of a line Flelmert’s method can also 
be used to constrain the direction of a line. In Figure 20.6 the bearing of line 
AB is to remain at its record value of N 0°04' E. The data for this trilaterated 
network are: 



FIGURE 20.6 Network for Example 20.3. 


Control Stations Station Initial Approximations 


Station 

X(m) 

Y (m) 

Station 

X(m) 

Y (m) 

A 

1000.000 

1000.000 

B 

1003.07 

3640.00 




C 

2323.07 

3638.46 




D 

2496.08 

1061.74 
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Distance Observations 


From 

To 

Distance (m) 

o-(m) 

From 

To 

Distance (m) 

a (m) 

A 

C 

2951.604 

0.025 

C 

D 

2582.534 

0.024 

A 

B 

2640.017 

0.024 

D 

A 

1497.360 

0.021 

B 

C 

1320.016 

0.021 

B 

D 

2979.325 

0.025 


Adjust this figure by the method of least squares holding the direction of the 
line AB using Helmert’s method. 


SOLUTION Using procedures discussed in Chapter 14, the reduced normal 
equations for the trilaterated system are 


2690.728 

-706.157 

-2284.890 

0.000 

405.837 

706.157 


-706.157 

2988.234 

0.000 

0.000 

706.157 

-1228.714 


-2284.890 

0.000 

2624.565 

529.707 

-8.737 

124.814 


0.000 

0.000 

529.707 

3077.557 

124.814 

-1783.060 


-405.837 

706.157 

-8.737 

124.814 

2636.054 

-742.112 


706.157 

-1228.714 

124.814 

-1783.060 

-742.112 

3015.328 


dx b 


-6.615 

dy b 


6.944 

dx c 


21.601 

dy c 


17.831 

dx d 


7.229 

_dy d _ 


11.304 


Following prototype Equation (15.9), 
azimuth of line AB is 


the linearized equation for the 


[78.13 


-0.09 0 


0 0 0 ] 


d % b 

dy b 

dx c 

dy c 

dx d 

dy d 


= [0.139] 


(/) 


The observation equation for the constrained direction [Equation (/)] is 
then added to the border of the matrix of reduced normal Equations (e), which 
yields 
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2690.728 

-706.157 

-2284.890 

0.000 

-405.837 

706.157 

78.13 

-706.157 

2988.234 

0.000 

0.000 

706.157 

-1228.714 

-0.09 

-2284.890 

0.000 

2624.565 

529.707 

-8.737 

124.814 

0.000 

0.000 

0.000 

529.707 

3077.557 

124.814 

-1783.060 

0.000 

405.837 

706.157 

-8.737 

124.814 

2636.054 

-742.112 

0.000 

706.157 

-1228.714 

124.814 

-1783.060 

-742.112 

3015.328 

0.000 

78.13 

-0.09 

0.000 

0.000 

0.000 

0.000 

0.000 


~ dx b " 


-6.615" 

d y b 


6.944 

dx c 


21.601 

dy c 

= 

17.831 

dx d 


7.229 

dy d 


11.304 

dx 2 


0.139 


This is a nonlinear problem, and thus the solution must be iterated until 
convergence. The first two iterations yielded the X matrices listed as X x and X 2 
below. The third iteration resulted in negligible corrections to the unknowns. 
The total of these corrections is shown as X T below. 


0.00179' 


' - 0 . 00001 ' 


0.00178' 

0.00799 


-0.00553 


0.00247 

0.00636 


0.00477 


0.01113 

0.01343 

X 2 = 

-0.00508 

X T = 

0.00835 

0.00460 


-0.00342 


0.00117 

0.01540 


-0.00719 


0.00821 

-0.00337 


-0.00359 


-0.00696 


Adding the coordinate corrections of X T to the initial approximations results 
in the final coordinates for stations B, C, and D of 


B: (1003.072,3640.003) C: (2323.081,3638.468) D: (2496.081,1061.748) 

Checking the solution: Using Equation (15.1), check to see that the direction 
of line AB was held to the value of the constraint. 

A: ab = tan’ 1 ( ) = 0°04'00" (Check!) 

AB V 2640.003 / 
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20.5 REDUNDANCIES IN A CONSTRAINED ADJUSTMENT 

The number of redundancies in an adjustment increases by one for each 
parameter that is removed by a constraint equation. An expression for deter¬ 
mining the number of redundancies is 


r = m — n + c (20.18) 

where r is the number of redundancies in the system, m the number of obser¬ 
vations in the system, n the number of unknown parameters in the system, and 
c the number of mathematically independent constraints applied to the sys¬ 
tem. In Example 20.2, there were seven observations in a differential leveling 
network that had four stations with unknown elevations. One constraint was 
added to the system of equations that fixed the elevation difference between 
B and E as -17.60. In this way, the elevation of B and E became mathemati¬ 
cally dependent. By applying Equation (20.18), it can be seen that the number 
of redundancies in the system isr = 7- 4+ l=4. Without the aforementioned 
constraint, this adjustment would have only 7-4 = 3 redundancies. Thus, the 
constraint added one redundant observation to the adjustment while making 
the elevations of B and E mathematically dependent. 

Care must be used when adding constraints to an adjustment. It would be 
possible to add as many mathematically independent constraint equations 
as there are unknown parameters. If that were done, all unknowns would be 
constrained or fixed, and it would be impossible to perform an adjustment. 
Furthermore, it is also possible to add constraints that are mathematically 
dependent equations. Under these circumstances, even if the system of 
equations has a solution, two mathematically dependent constraints would 
remove only one unknown parameter, and thus the redundancies in the system 
would increase by only one. 


20.6 ENFORCING CONSTRAINTS THROUGH WEIGHTING 

The methods described previously for handling constraint equations can often 
be avoided simply by overweighting the observations to be constrained in a 
weighted least squares adjustment. This was done in Example 16.2 to fix the 
direction of a line. As a further demonstration of the procedure of enforcing 
constraints by overweighting, Example 20.3 will be adjusted by writing obser¬ 
vation equations for azimuth AB and the control station coordinates X A and 
Y A . These observations will be fixed by assigning a 0.001" standard deviation 
to the azimuth of line AB and standard deviations of 0.001 ft to the coordinates 
of Station A. 

The ./, K, and W matrices for the first iteration of this problem are listed 
below. Note that the numbers have been rounded to three-decimal places for 
display purposes only. 
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■ -0.448 

-0.894 

0.000 

0.000 

0.448 

0.894 

0.000 

0.000 


-0.001 

-1.000 

0.001 

1.000 

0.000 

0.000 

0.000 

0.000 


0.000 

0.000 

-1.000 

0.001 

1.000 

-0.001 

0.000 

0.000 


0.000 

0.000 

0.000 

0.000 

-0.067 

0.998 

0.067 

-0.997 

/ = 

-0.999 

-0.041 

0.000 

0.000 

0.000 

0.000 

0.999 

0.041 


0.000 

0.000 

-0.050 

0.865 

0.000 

0.000 

0.050 

-0.865 


-78.130 

0.091 

78.130 

-0.091 

0.000 

0.000 

0.000 

0.000 


1.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 


0.000 

1.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 


r-0.0031 


K = 


0.015 

0.015 

0.012 

0.007 


- 0.021 


0.139 

0.000 

0.000 


W = 


0.025 2 

0 

0 

0 

0 

0 

0 

0 

0 


0 

1 

0.024 2 

0 

0 

0 

0 

0 

0 

0 


0 

0 

1 

0 . 021 2 

0 

0 

0 

0 

0 

0 


0 

0 

0 

1 

0.024 2 

0 

0 

0 

0 

0 


0 

0 

0 

0 

1 

0 . 021 2 

0 

0 

0 

0 


0 0 

0 0 

0 0 

0 0 

0 0 

0 

0.025 2 

o 

0.001 2 

0 0 

0 0 


0 

0 

0 

0 

0 

0 

0 

1 

0.001 2 

0 


0 

0 

0 

0 

0 

0 

0 

0 

1 

0.001 2 


The results of the adjustment (from the program ADJUST) are presented 
below. 


* * * * * * * * * * * * * * * * * 

Adjusted stations 

***************** 

Standard error ellipses computed 


Station 

X 

Y 

Sx 

sy 

Su 

Sv 

t 

A 

1,000.000 

1,000.000 

0.0010 

0.0010 

0.0010 

0.0010 

135.00° 

B 

1,003.072 

3,640.003 

0.0010 

0.0217 

0.0217 

0.0010 

0.07° 

C 

2,323.081 

3,638.468 

0.0205 

0.0248 

0.0263 

0.0186 

152.10° 

D 

2,496.081 

1,061.748 

0.0204 

0.0275 

0.0281 

0.0196 

16.37° 
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****************************** 

Adjusted Distance Observations 

****************************** 

Station Station 


Occupied 

Sighted 

Distance 

V 

s 

A 

c 

2,951.620 

0.0157 

0.0215 

A 

B 

2,640.004 

-0.0127 

0.0217 

B 

c 

1,320.010 

-0.0056 

0.0205 

c 

D 

2,582.521 

-0.0130 

0.0215 

D 

A 

1,497.355 

-0.0050 

0.0206 

B D 2,979.341 

***************************** 

Adjusted Azimuth Observations 

***************************** 

Station Station 

0.0159 

0.0214 

Occupied 

Sighted 

Azimuth 

V 

S" 

A 

B 

o 

o 

4^ 

o 

o 

0.0" 

0.0" 


**************************************** 

Adjustment Statistics 

**************************************** 

Iterations = 2 
Redundancies = 1 
Reference Variance = 1.499 
Reference So = ±1.2 


Passed X 2 test at 95.0% significance level! 

X 2 lower value =0.00 
X 2 upper value = 5.02 

A priori value of 1 used for reference variance 
in computations of statistics. 

Convergence! 

Notice in the previous adjustment that the control station coordinates 
remained fixed and the residual of the azimuth of line AB is zero. Thus, the 
azimuth of line AB was held fixed without the inclusion of any constraint 
equation. It was simply constrained by overweighting the observation. Also 
note that the final adjusted coordinates of stations 5, C, and D match the 
solution in Example 20.3. 

PROBLEMS 

Note: For problems requiring least squares adjustment, if a computer program 
is not distinctly specified for use in the problem, it is expected that the least 
squares algorithm will be solved using the program MATRIX, which is avail¬ 
able in the book’s companion website. Partial answers to problems that are 
marked with an asterisk are provided in Appendix H. 
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* 20.1 Given the following observed lengths in a trilateration survey, adjust 
the survey by least squares using the elimination of constraints 
method to hold the coordinates of A at x a = 30,000.00 ft and y a = 
30,000.00 ft, and the azimuth of line AB to 2°31'56"± 3.0" from 
North. Find the adjusted coordinates of B, C, and D. 


Distance Observations 


Course 

Distance (ft) 

s (ft) 

Course 

Distance (ft) 

s (ft) 

AB 

9,813.20 

0.033 

BC 

9,629.69 

0.033 

AC 

13,764.18 

0.044 

BD 

15,006.82 

0.047 

AD 

11,395.99 

0.037 

CD 

9,943.63 

0.033 


Initial Coordinates 


Station 

X(ft) 

Y (ft) 

B 

30,433.56 

39,803.63 

C 

40,054.84 

39,399.65 

D 

41,386.93 

29,545.64 


20.2 Do Problem 20.1 using Fielmert’s method. 

20.3 Do Problem 20.1 using the method of weighting for the azimuth. 

20.4 Repeat Problem 20.1 using the following data. 


Control Station Approximate Coordinates 


Station 

X(m) 

Y (m) 

Station 

X(m) 

Y (m) 

A 

6509.325 

6681.064 

B 

6402.643 

7619.260 




C 

7329.700 

7632.254 




D 

7427.389 

6765.248 


Distance Observations 


Occupied 

Sighted 

Distance (m) 

S (m) 

A 

B 

944.243 

0.005 

A 

C 

1256.093 

0.006 

A 

D 

921.916 

0.005 

B 

C 

927.136 

0.005 

B 

D 

1333.965 

0.006 

C 

D 

872.490 

0.005 


Azimuth Observation 


Course 

Azimuth 

S 

AB 

353°30'46" 

3.2" 
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20.5 Do Problem 20.4 using Helmert’s method. 

20.6 Do Problem 20.4 using the method of weighting for the azimuth. 

*20.7 Adjust the following differential leveling data using the elimination 
of constraints method. Hold the elevation of A to 136.485 m and the 
elevation difference AElev B£ > to -3.750 m. 


Elevation Differences 


From 

To 

AElev (m) 

S (m) 

A 

B 

-7.466 

0.030 

B 

C 

4.101 

0.030 

D 

E 

5.842 

0.037 

E 

A 

5.368 

0.042 

C 

D 

-7.932 

0.021 


20.8 Repeat Problem 20.7 using Helmert’s method. 

20.9 Repeat Problem 20.7 using the weighting method. 

20.10 Do Problem 13.14 holding distance BC to 100.00 ft. 

*(a) Use the elimination of constraints method. 

(b) Use Helmert’s method. 

(c) Compare the results of the adjustments from the different 
methods. 

20.11 Do Problem 13.15 holding the elevation difference between V and Z 
to 30.00 ft. 

(a) Use the elimination of constraints method. 

(b) Use Helmert’s method. 

(c) Use the method of overweighting technique. 

(d) Compare the results of the adjustments from the different 
methods. 

20.12 Do Problem 12.15 holding the difference in elevation between Stations 
2 and 8 to 5.500 m. 

(a) Use the elimination of constraints method. 

(b) Use Helmert’s method. 

(c) Use the method of overweighting technique. 

*20.13 Assuming stations A and D are second-order, class I horizontal 
control (1:50,000), do Problem 14.9 by including the control in the 
adjustment. 
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20.14 Do Problem 15.8 assuming station A is first-order horizontal con¬ 
trol (1:100,000) and D is second-order, class II horizontal control 
(1:20,000) using the method of weighting. 

20.15 Do Problem 15.11 assuming the control stations A and B are first 
order control (1:100,000) and stations G and H are second-order, class 
II horizontal control (1:20,000) using the method of weighting. 

20.16 Do Problem 16.16 assuming Stations A and D are third-order, class 
I control (1:10,000) using the method of weighting. 


PRACTICAL PROBLEMS 

20.17 Develop a computational program that computes the coefficients for 
the / matrix in a trilateration adjustment with a constrained azimuth. 
Use the program to solve Problem 20.9. 

20.18 Develop a computational program that computes a constrained 
least squares adjustment of a trilateration network using Helmert’s 
method. Use this program to solve Problem 20.13. 


CHAPTER 21 


BLUNDER DETECTION IN 
HORIZONTAL NETWORKS 


21.1 INTRODUCTION 

Up to this point, data sets were assumed to be free of blunders. However, when 
adjusting real observations, the data sets are seldom blunder free. Not all blun¬ 
ders are large, but no matter their sizes, it is desirable to remove them from the 
data set. In this chapter, methods used to detect blunders before and after an 
adjustment are discussed. 

Many examples can be cited that illustrate mishaps that have resulted from 
undetected blunders in survey data. However, few could have been more costly 
and embarrassing than a blunder of about 1 mile that occurred in an early 
nineteenth-century survey of the border between the United States and Canada 
near the north end of Lake Champlain. Following the survey, construction 
of a US military fort was begun. The project was abandoned two years later 
when the blunder was detected, and a resurvey showed that the fort was actu¬ 
ally located on Canadian soil. The abandoned facility was subsequently named 
“Fort Blunder!” 

As discussed in previous chapters, observations are normally distributed. 
This means that occasionally, large random errors will occur. However, in 
accordance with theory, this seldom happens. Thus, large errors in data sets 
are more likely to be blunders than random errors. Common blunders in 
data sets include number transposition, entry and recording errors, station 
misidentihcations, and others. When blunders are present in a data set, a least 
squares adjustment may not be possible or will, at a minimum, produce poor 
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or invalid results. To be safe, the results of an adjustment should never be 
accepted without an analysis of the post-adjustment statistics. 


21.2 A PRIORI METHODS FOR DETECTING BLUNDERS 
IN OBSERVATIONS 

I 11 performing adjustments, it should always be assumed that there are 
possible observational blunders in the data. Thus, appropriate methods should 
be used to isolate and remove them. It is especially important to eliminate large 
blunders prior to the adjustment of nonlinear equations, since blunders can 
cause the solution to diverge. In this section, several methods are discussed 
that can be used to isolate blunders in a horizontal adjustment. 

21.2.1 Use of the K Matrix 

In horizontal surveys, the easiest method available for detecting blunders is to 
use the redundant observations. When the approximate station coordinates are 
computed using standard surveying methods, they should be close to their final 
adjusted values. Thus, the difference between observations computed from the 
approximate coordinates and their observed values (K matrix) are expected to 
be small in size. If an observational blunder is present, there are two possible 
situations that can occur with regard to the A'-matrix values. If the observation 
containing a blunder is not used to compute initial coordinates, its correspond¬ 
ing A'-matrix value will be relatively large. However, if an observation with a 
blunder is used in the computation of the initial station coordinates, the remain¬ 
ing redundant observations to that station will have relatively large values. 

Figure 21.1 shows the two possible situations. In Figure 21.1(a), a distance 
blunder is present in line BP and is shown by the length PP'. However, this 
distance was not used in computing the coordinates of station P and thus, the 


To C To C 



FIGURE 21.1 Presence of distance blunder in computations. 
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A'-matrix value for BP' - BP 0 will suggest the presence of a blunder by its 
relatively large size. In Figure 21.1(6), the distance blunder in BP was used to 
compute the initial coordinates of station P'. In this case, the redundant angle 
and distance observations connecting P with A, C, and D will show large dis¬ 
crepancies in the ATmatrix. In the latter case, it is possible that some redundant 
observations may agree reasonably with their computed values, since a shift in a 
station’s position can occur along a sight line for an angle, or along a radius for 
a distance. Still most redundant observations will have large Ai-matrix values, 
and thus raise suspicions that a blunder exists in one of the observations used 
to compute the coordinates of station P. 


21.2.2 Traverse Closure Checks 

As mentioned in Chapter 8, errors can be propagated throughout a traverse to 
determine the anticipated closure error. Large complex networks can be broken 
into smaller link and loop traverses to check estimated closure errors against 
their actual values. When a loop fails to meet its estimated closure, the obser¬ 
vations included in the computations should be checked for blunders. 

Figure 21.2(a) and (6) shows a graphical technique to isolate a traverse 
distance blunder and angular blunder, respectively. In Figure 21.2(a), a blunder 
in distance CD is shown. Notice that the remaining courses, DE and EA, are 
translated by the blunder in the direction of course CD. Thus, the length of 
closure line (A'A) will be nearly equal to the length of the blunder in CD with 
a direction that is consistent with the azimuth of CD. Since other observations 
contain small random errors, the length and direction of closure line. A'A , will 
not match the blunder exactly. However when one blunder is present in a tra¬ 
verse, the misclosure and the blunder will be close in both length and direction. 

In the traverse of Figure 21.2(6), the effect of an angular blunder at traverse 
station D is illustrated. As shown, the courses DE, EE, and FA' will be rotated 
about station D. Thus, the perpendicular bisector of the closure line A A’ will 




FIGURE 21.2 Effects of a single blunder on the traverse closure error. 
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point to station D. Again, due to random errors in other observations, the 
perpendicular bisector may not intersect the observation with the blunder pre¬ 
cisely, but it should be close enough to identify the angle with the blunder. Since 
the angle at the initial station is not used in traverse computations, it is possible 
to isolate a single angular blunder by beginning traverse computations at the 
station with the suspected blunder. In this case, when the blunder is not used in 
the computations, estimated misclosure errors will be met and the blunder can 
be isolated to the single unused angle. Thus, in Figure 21.2 (b), if the traverse 
computations were started at station D and used an assumed azimuth for the 
course of CD, the traverse misclosure when returning to D would be within esti¬ 
mated tolerance since the angle at D is not used in the traverse computations. 
Of course this means that the angles should not be adjusted prior to the traverse 
computations. 


21.3 A POSTERIORI BLUNDER DETECTION 

When doing a least squares adjustment involving more than the minimum 
amount of control, both a minimally constrained and overconstrained adjust¬ 
ment should be performed. In a minimally constrained adjustment, the data 
need to satisfy the appropriate geometric closures and are not influenced by 
any control errors. After the adjustment, a x 2 test 1 can be used to check the a 
priori value of the reference variance against its a posteriori estimate. However, 
this test is not a good indicator of the presence of a blunder since it is sensi¬ 
tive to poor relative weighting. Thus, the a posteriori residuals should also be 
checked for the presence of large discrepancies. If no large discrepancies are 
present, the observational weights should be altered and the adjustment rerun. 
Since / 2 test is sensitive to weights, the procedures described in Chapters 7 
through 10 should be used for building the stochastic model of the adjustment. 

Besides the sizes of the residuals, the signs of the residuals may also indicate a 
problem in the data. From normal probability theory, residuals are expected to 
be small and randomly distributed. In Figure 21.3, a small section of a larger 
network is shown. Notice that the distance residuals between stations A and 
B are all positive. This is not expected from normally distributed data. Thus, 
it is possible that either a blunder or systematic error is present in some or all 
of the survey. If both A and B are control stations, part of the problem could 
stem from control coordinate discrepancies. This possibility can be isolated by 
doing a minimally constrained adjustment. 

Although residual sizes can suggest observational errors, they do not 
necessarily identify the observations that contain blunders. This is due to 
the fact that least squares solution generally spreads a large observational 
error or blunder out from its source radially. However, this condition is not 


1 Statistical testing was discussed in Chapter 4. 
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FIGURE 21.3 Distribution of residuals by sign. 


unique to least squares adjustments, since any arbitrary adjustment method, 
including the compass rule for traverse adjustment, will also spread a single 
observational error throughout the entire observational set. 

While an abnormally large residual may suggest the presence of a blunder 
in an observation, this is not always true. One reason for this could be poor 
relative weighting in the observations. For example, suppose that angle GAH in 
the Figure 21.4 has a small blunder but has been given a relatively high weight. 
In this case, the largest residual may well appear in a length between stations 
G and //, B and H , C and F, and most noticeably between D and E due to 
their distances from station A. This is because the angular blunder will cause 
the network to spread or compress. When this happens, the sign of the distance 


4 



FIGURE 21.4 Survey network. 
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residuals between G and //, B and //, C and F, and D and E may all be the same 
and thus, may indicate the problem. Again, this situation can be minimized by 
using proper methods to determine observational variances so they are truly 
reflective of the estimated errors in the observations. 


21.4 DEVELOPMENT OF THE COVARIANCE MATRIX 
FOR THE RESIDUALS 

I 11 Chapter 5 it was shown how a sample data set could be tested at any 
confidence level to isolate observational residuals that were too large. The 
concept of statistical blunder detection in surveying was introduced in the 
mid-1960s and utilizes the cofactor matrix for the residuals. To develop this 
matrix, the adjustment of a linear problem can be expressed in matrix form as 

L+V = AX+C (21.1) 

where C is a constants vector, A is the coefficient matrix, X is the estimated 
parameter matrix, L is the observation matrix, and V is the residual vector. 
Equation (21.1) can be rewritten in terms of V as 


V = AX - T (21.2) 

where T = L- C that has a covariance matrix of W~ l = S 2 Q n . The solution of 

Equation (21.2) results in the expression 

X= (A t WA)- 1 A t WT (21.3) 

Letting t represent a vector of true errors for the observations, Equation (21.1) 
can be written as 

L-e = AX+C (21.4) 

where X is the true value for the unknown parameter X, and thus 

T = L-C = AX + e (21.5) 

Substituting Equations (21.3) and (21.5) into Equation (21.2) yields 

V = A(A t WA)-'A j W(AX+£) - (AX + e) (21.6) 

Expanding Equation (21.6) results in 

V = A(A t WA)~ 1 A t We -e + A(A T WA)~ l A T WAX - AX 


(21.7) 
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Since (A T WA) 1 = A 1 W X A T , Equation (21.7) can be simplified to 

V = A(A t WA)- 1 A t We-e (21.8) 

Factoring We from Equation (21.8), yields 

V=-(W~ 1 - A(A t WA)~ l A r ) We (21.9) 

Recognizing ( A T W4 )~ 1 = Q xx and defining Q rv = W~ l - AQ XX A T , 
Equation (21.9) can be rewritten as 

V = -Q vv We (21.10) 

where Q vv = W~ l - A Q xx A T = W~ ] - Q„. 

If we let R be the product of W and Q vr , the R matrix is both singular and 
idempotent. Being singular, it has no inverse. When a matrix is idempotent, the 
following properties exist for the matrix: (a) The square of the matrix is equal 
to the original matrix (i.e., RR = R), (b) every diagonal element is between 
zero and 1, and (c) the sum of the diagonal elements, known as the trace of the 
matrix , equals the degrees of freedom in the adjustment. This latter property 
is expressed mathematically as 


r n + r 22 + ■ ■ ■ + r mm = degrees of freedom (21.11) 


{d) The sum of the square of the elements in any single row or column equals 
the diagonal element. That is, 

r u = r n + 4 + •'' + r ln = r u + 4 + ■'' + r ii ( 2M2 ) 


Now consider the case when all observations have zero errors except for a par¬ 
ticular observation /, that contains a blunder of size A/,. A vector of the true 
errors is expressed as 


Ar = A IjEj 


' 0 ' 


'O' 

0 


0 

0 

= A k 

0 

Mi 

1 

0 


0 

0 


_0 


i’l l ') 


If the original observations are uncorrelated, the specific correction for Ar, 
can be expressed as 

A v ; - = -quWuMj = -rAlj (21.14) 
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where q u is the z'th diagonal of the Q vv matrix, w u is the z'th diagonal term of the 
weight matrix, W, and r i = q u w u is the observation’s redundancy number. 

When the system has a unique solution, r t will equal zero. If the observation 
is overconstrained, r, would equal one. The redundancy numbers provide 
insight into the geometric strength of the adjustment. An adjustment that in 
general has low redundancy numbers will have observations that lack sufficient 
checks to isolate blunders, and thus the chance for undetected blunders to exist 
in the observations is high. Conversely, a high overall redundancy number 
enables a high level of internal checking of the observations, and thus there is 
a lower chance of accepting observations that contain blunders. The quotient 
of rim is called the relative redundancy of the adjustment where r is the total 
number of redundant observations in the system and m is the number of 
observations. As discussed in Section 21.9.1, a well-designed network will have 
individual observational redundancy numbers that are all close to the relative 
redundancy number. 


21.5 DETECTION OF OUTLIERS IN OBSERVATIONS: 

DATA SNOOPING 

Equation (21.10) defines the covariance matrix for the vector of residu¬ 
als, v r From this the standardized residual is computed using the appropriate 
diagonal element of the Q vv matrix as 


v 



(21.15) 


where v ; is the standardized residual, v, the computed residual, and q u the 
diagonal element of the Q vv matrix. Using the Q rr matrix, the standard devia¬ 
tion in the residual is S 0 ^qlj. Thus, if the denominator of Equation (21.15) is 
multiplied by S Q , a t statistic is defined. If the residual is significantly different 
from zero, the observation used to derive the statistic is considered to be a blun¬ 
der. As suggested by Willem Baarda (1968), the test statistic for this hypothesis 
test is 



Baarda computed rejection criteria for various significance levels (see 
Table 21.1), determining the a and /i levels for the Type I and Type II errors. 
The interpretation of these criteria is shown in Figure 21.5. When a blunder 
is present in the data set, the t distribution is shifted, and a statistical test for 
this shift may be performed. As with any other statistical test, two types of 
errors can occur. A Type I error occurs when data are rejected that do not 
contain blunders, and a Type II error occurs when a blunder is not detected in 
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TABLE 21.1 Rejection Criteria with Corresponding Significance Levels 


a 

1 — a 

P 

1 ~P 

Rejection Criteria 

0.05 

0.95 

0.80 

0.20 

2.8 

0.001 

0.999 

0.80 

0.20 

4.1 

0.001 

0.999 

0.999 

0.001 

6.6 



FIGURE 21.5 Effects of a blunder on the t distribution. 


a data set where one is actually present. The rejection criteria are represented 
by the vertical line in Figure 21.5 and their corresponding significance levels 
are shown in Table 21.1. In practice, authors 2 have reported that a value of 
3.29 also works as a criterion for rejection of blunders. 

Thus, the approach is to use a rejection level given by a t distribution with 
r - 1 degrees of freedom. The observation with the largest absolute value of 
tj as given by Equation (21.17) is rejected when it is greater than the rejection 
level. That is, the observation is rejected when 


--— > rejection level 

Soy/yii 


(21.17) 


Since the existence of any blunder in the data set will affect the remaining 
observations, and since Equation (21.18) is dependent on S 0 whose value was 
computed from data containing blunders, all observations that are detected 
as blunders should not be removed in a single pass. Instead, only the largest 
or largest independent group of observations should be deleted. Furthermore, 
since Equation (21.18) is dependent on S 0 , it is possible to rewrite the equation 
so that it can be computed during the final iteration of a nonlinear adjustment. 

References relating to the use of 3.29 as the rejection criteria are made in Amer, F. (1979) and 
Harvey (1994). 
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In this case, the appropriate equation is 


\j 4 u 


> S 0 x rejection level 


(21.18) 


A summary of procedures for this manner of blunder detection is as follows: 

Step 1: Locate all standardized residuals that meet the rejection criteria of 
Equation (21.17) or (21.18). 

Step 2: Remove the largest detected blunder or unrelated blunder groups. 
Step 3: Rerun the adjustment. 

Step 4: Continue steps 1 through 3 until all detected blunders are removed. 
Step 5: If more than one observation is removed in steps 1 through 4, reen¬ 
ter the observations in the adjustment in a one-at-a-time fashion. Check 
the observation after each adjustment to see if it is again detected as a 
blunder. If it is, remove it from the adjustment or have that observation 
reobserved. 

Again, it should be noted that this form of blunder detection is sensitive to 
improper relative weighting in observations. Thus, it is important to use weights 
that are reflective of the observational errors. Proper methods of computing 
estimated errors in observations, and weighting, were discussed in Chapters 7 
through 10. 

21.6 DETECTION OF OUTLIERS IN OBSERVATIONS: 

THE TAU CRITERION 

Data snooping is based on Equation (21.16) being a / statistic. However, 
when a blunder is present in a data set both S 0 and S v are affected by the blun¬ 
der. Thus, Alan J. Pope (1976) stated that Equation (21.16) is instead a t (tau) 
statistic where the critical r value is computed as 





(21.19) 


In Equation (21.19), the probability of the computed r from Equation (21.16) 
being greater than T a/1 is 1 - (1 - a) 1 /", which is referred to as the transforma¬ 
tion for control of the Type I error where n is conventionally taken to be the 
number of nonspur observations in the adjustment. A nonspur observation is 
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any observation where a v and v are nonzero. Recalling Equation (21.16) and 
using the r criterion, observations are considered for rejection when 

|v,| 

^>V2 ( 21 - 2 °) 

The procedures for eliminating and removing blunders using the r statistic 
are the same as those used in data snooping. That is, the observation with 
the largest standardized residuals that is detected as an outlier or blunder 
using Equation (21.20) is removed from the data set and the adjustment rerun. 
This procedure is continued, removing a single observation at a time until 
no more observations are detected as outliers or blunders. Again the rejected 
observations should be reinserted into the adjustment in a one-at-a-time 
fashion to determine if they are still detected as blunders. Any observations 
that are detected as a blunder a second time are discarded as blunders or must 
be reobserved. 

Even though data snooping and the r criterion are theoretically different, 
they have been shown in practice to yield similar results. Thus, the matter of 
which method of statistical blunder detection to use is a matter of personal 
preference. As shown in Figure 21.6, the software ADJUST allows the user to 
select the blunder detection method of their choice. 


ii Horizontal Least Squares Ad... — □ X 


Computation Options 

r Adjust Control 
r Adjusted Observational Errors 
r Compute Ellipses |o 05 
r Standard Ellipse 

1% of radial error 


T x Test [o"o5 

Blunder Detection 
I* |iti snooping 


329 


Tnu criterion 

r Create Script File 
I - Print Matrices 
r Simulation 


w 


Maximum Iterations 


✓ OK I 

X Cancel| 

? Help 


FIGURE 21.6 Data set with blunders. 
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21.7 TECHNIQUES USED IN ADJUSTING CONTROL 

As discussed in Chapter 20, some control is necessary in each adjustment. 
However, since control itself is not perfect, this raises the question of how 
control should be managed. If control stations that contain errors are over¬ 
weighted, the adjustment will associate the control errors with the observations 
improperly. This effect can be removed by using only the minimum amount 
of control required to fix the project. Table 21.2 lists the type of survey 
versus the minimum amount of control. Thus, in a horizontal adjustment, 
if the coordinates of only one station and the direction of only one line are 
held fixed, the observations will not be constricted by the control. That is, 
the observations will need to satisfy the internal geometric constraints of 
the network only. If more than minimum control is used, these additional 
constraints will be factored into the adjustment. 

Statistical blunder detection can help identify weak control or the presence 
of systematic errors in observations. Using a minimally constrained adjust¬ 
ment, the data set is screened for blunders. After becoming confident that 
the blunders are removed from the data set, an overconstrained adjustment 
is performed. Following the overconstrained adjustment, an F test is used to 
compare the ratio of the reference variances from the minimally constrained 
and overconstrained adjustments. The ratio of the two reference variances 
should be 1, 3 

If the two reference variances are found to be statistically different, two pos¬ 
sible causes might exist. The first is that there are errors in the control that must 
be isolated and removed. The second is that the observations contain system¬ 
atic errors. Since systematic errors are not compensating in nature, they will 
appear as blunders in the overconstrained adjustment. If systematic errors are 
suspected, they should be identified and removed from the original data set 
and the entire adjustment procedure performed again. If no systematic errors 


TABLE 21.2 Requirements for a Minimally Constrained Adjustment 


Survey Type 

Minimum Amount of Control 

Differential leveling 

1 bench mark 

Horizontal survey 

1 point with known xy coordinates 

1 course with known azimuth 

GNSS survey 

1 point with known geodetic coordinates 


3 The ratio of the reference variances from the minimally constrained and constrained adjust¬ 
ments should be one since both reference variances should be statistically equal. That is, 

2 = a 1 

minimally constrained over constrained' 
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are identified, 4 different combinations of control stations should be used in the 
constrained adjustments until the problem is isolated. By following this type of 
systematic approach, a single control station that has inconsistent coordinates 
is isolated. 

With this stated, it should be realized that the ideal amount of control in 
each survey type is greater than the minimum. In fact for all three survey 
types, a minimum of three fixed stations (control) is always preferable. For 
example, in a differential leveling survey with only two bench marks, it would 
be impossible to isolate the problem by simply removing one bench mark from 
the adjustment. Flowever, if three bench marks are used, a separate adjustment 
containing only two of the bench marks can be run until the offending bench 
mark is isolated. 

Extreme caution should always be used when dealing with control stations. 
Although it is possible that a control station was disturbed or that the original 
published coordinates contained errors, this is not always the case. A prudent 
surveyor should check for physical evidence of disturbance and talk with other 
surveyors before deciding to discard control. If the station was set by a local, 
state, or federal agency, the surveyor should contact the proper authorities 
and report any suspected problems. People in the agency familiar with the 
control may help explain any apparent problem. For example, it is possible 
that the control used in the survey was established by two previously noncon¬ 
necting surveys. In this case, the relative accuracy of the stations was never 
checked when they were established. Another common problem with control 
is the connection of two control points from different realizations of the same 
reference frame. As an example, suppose a first-order control station from a 
conventional survey and a High Accuracy Reference Network (HARN) sta¬ 
tion from a GNSS survey are used as control in a survey, these two stations 
come from different national adjustments and are thus in different realizations 
of the same datum. Their coordinates will most likely not agree with each other 
in an adjustment. 

21.8 A DATA SET WITH BLUNDERS 

Example 21.1 The network shown in Figure 21.7 was established to provide 
control for mapping in the area of stations 1 through 6. It began from two 
National Geodetic Survey, Second Order, Class II (1:20,000 precision) control 
stations, 2000 and 2001. The data for the job were gathered by five different 
field crews in a class environment. The procedures discussed in Chapter 7 were 
used to estimate the observational errors. The problem is to check for blunders 
in the data set using the data snooping method with a rejection level of 3.29»S 0 . 

4 When adjusting data that cover a large region, (e.g., spherical excess, reduction to these ellipsoid, 
etc.) it is essential that geodetic corrections to the data be considered and applied where necessary. 
These corrections are systematic in nature and can cause errors when fitting to more than minimal 
control. 
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Control Stations 


Station 

Northing (ft) 

Easting (ft) 

2000 

419,710.09 

2,476,334.60 

2001 

419,266.82 

2,476,297.98 

Angle Observations 


Backsight 

Occupied 

Foresight 

Angle 

S(") 

102 

2000 

2001 

109°10'54.0" 

25.5 

2000 

102 

103 

162°58'16.0" 

28.9 

102 

103 

1 

172° 01'43.0" 

11.8 

2000 

2001 

201 

36°04'26.2" 

7.4 

2001 

201 

202 

263°54'18.7" 

9.7 

201 

202 

203 

101°49'55.0" 

8.1 

202 

203 

3 

176°49'10.0" 

8.4 

203 

3 

2 

8°59'56.0" 

6.5 

2 

1 

3 

316°48'00.5" 

6.3 

3 

5 

4 

324°17'44.0" 

8.1 

6 

5 

3 

338°36'38.5" 

10.7 

1 

5 

3 

268°49'32.5" 

9.8 

2 

5 

3 

318°20'54.5" 

7.0 

2 

3 

1 

51°07'11.0" 

7.2 

2 

3 

5 

98°09'36.5" 

10.3 

2 

3 

6 

71°42'51.5" 

15.1 

2 

3 

4 

167°32'28.0" 

14.5 
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Distance Observations 


From 

To 

Distance (ft) 

A (ft) 

2001 

201 

425.90 

0.022 

201 

202 

453.10 

0.022 

202 

203 

709.78 

0.022 

203 

3 

537.18 

0.022 

5 

3 

410.46 

0.022 

5 

4 

397.89 

0.022 

5 

6 

246.61 

0.022 

5 

1 

450.67 

0.022 

5 

2 

629.58 

0.022 

3 

2 

422.70 

0.022 

3 

1 

615.74 

0.022 

3 

5 

410.44 

0.022 

3 

6 

201.98 

0.022 

3 

4 

298.10 

0.022 

1 

2 

480.71 

0.022 

1 

3 

615.74 

0.022 

2000 

102 

125.24 

0.022 

102 

103 

327.37 

0.022 

103 

1 

665.79 

0.022 

The approximate coordinates were computed for the stations as follows: 

Station 


Northing (ft) 

Easting (ft) 

1 


420,353.62 

2,477,233.88 

2 


419,951.98 

2,477,497.99 

3 


420,210.17 

2,477,832.67 

4 


420,438.88 

2,478,023.86 

5 


420,567.44 

2,477,630.64 

6 


420,323.31 

2,477,665.36 

102 


419,743.39 

2,476,454.17 

103 


419,919.69 

2,476,728.88 

201 


419,589.24 

2,476,576.25 

202 


419,331.29 

2,476,948.76 

203 


419,819.56 

2,477,463.90 

SOLUTION Do the 

a priori check of the computed observations versus 

their A'-matrix values. 

In this check, a multiplier of 1000.S', where S is the 

standard deviation of the observation, was used 

as a tolerance. An ADJUST 

data hie. Example 21-l.dat, 

is available on the 

companion website for this 

book. This hie has the 

same 

format as the data hie used in a horizontal least 

squares adjustment. The option to perform an a priori check of data hies is 
found under the estimated errors submenu of the programs menu in ADJUST. 

In this check, the distance of 3^1 had a discrepancy of 50 ft from its 


computed value. Additionally, the angle 102-103-1 differed from its computed 
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value by more than 2°. These differences indicate that problems exist in 
the observations. However, these differences should not create a problem 
with convergence during the adjustment, since the observations remained 
in the data set when the adjustment was attempted. The results of the first 
trial adjustment are shown below. The software used the rejection criteria 
procedure based on Equation (21.18) for its blunder detection. The column 
headed Std. Res. represents the standardized residual of the observation as 
defined by Equation (21.15) and the column headed by Red. Num. represents 
redundancy number of the observation as defined by Equation (21.14). 


**** Adjusted Distance Observations **** 


No. | 

From | 

To 


1 

Distance | Residual 

| Std. Res. 

| Red 

Num. | 


1| 

1 | 


3 

1 

616.234 | 0.494 

| 26.148 

1 

0.7458 | 


2 j 

1 


2 

1 

480.943 | 0.233 

| 12.926 

1 

0.6871 | 


3 | 

1 


3 

1 

616.234 | 0.494 

1 26.148 

1 

0.7458 | 


41 

3 | 


4 

1 

267.044 | -31.056 

j -1821.579 

1 

0.6169 j 


5 | 

3 | 


6 

1 

203.746 | 1.766 

j 107.428 

1 

0.5748 | 


61 

3 | 


5 

1 

413.726 | 3.286 

| 171.934 

1 

0.7719 | 


7 j 

3 | 


2 

1 

422.765 | 0.065 

| 3.500 

1 

0.7312 | 


81 

5 | 


2 

1 

630.949 | 1.369 

| 75.909 

1 

0.6791 | 


91 

5 | 


1 

1 

449.398 | -1.272 

| -79.651 

1 

0.5377 | 


10 

5 | 


6 

1 

247.822 | 1.212 

| 75.418 

1 

0.5488 | 


11 

5 | 


4 

1 

407.125 | 9.235 

| 631.032 

1 

0.4529 | 


12 | 

5 | 


3 

1 

413.726 | 3.266 

| 170.888 

1 

0.7719 | 


13 1 

102 | 

103 

1 

327.250 | -0.120 

| -17.338 

1 

0.1018 | 


14 

103 | 


1 

1 

665.702 | -0.088 

| -12.395 

1 

0.1050 | 


15 | 

201 | 

202 

1 

453.362 | 0.262 

1 91.903 

1 

0.0172 


161 

202 | 

203 

1 

709.856 | 0.076 

| 10.737 

1 

0.1048 


17 

203 | 


3 

1 

537.241 | 0.061 

| 8.775 

1 

0.1026 | 


181 

2000 | 

102 

1 

125.056 | -0.184 

i -28.821 

1 

0.0868 | 


191 

2001 | 

201 

1 

425.949 | 0.049 

| 7.074 

1 

0.1008 | 





**** Adjusted Angle Observations **** 




No. | 

From | 

Occ 

1 


To | Angle | Residual | Std. Res. 

| Red. Num 

1 

1| 

2 | 

1 

1 


3 | 316°49'55.1" | 

114.6" | 

28.041 

| 0.4164 

1 

2 | 

2 | 

3 

1 


4 | 167°36'00.2" | 

212.2" [ 

25.577 

I 0.3260 

1 

3 | 

2 | 

3 

1 


6 | 71°43'01.5" | 

10.0" | 

1.054 

| 0.3990 

1 

4 j 

2 | 

3 

1 


5 | 97°55'09.3" | 

-867.2" | - 

101.159 

| 0.6876 

1 

5 | 

2 | 

3 

1 


1 | 51°06'14.6" | 

-56.4" | 

-11.156 

| 0.4985 

1 

61 

203 | 

3 

1 


2 | 8°59'36.3" | 

-19.7" | 

-13.003 

j 0.0550 

1 

7 

2 | 

5 

1 


3 | 318°25'14.4" | 

259.9" | 

44.471 

| 0.6949 

1 

81 

1 

5 

1 


3 | 268°58'49.8" | 

557.3" [ 

78.590 

| 0.5288 

1 

9| 

6 1 

5 

1 


3 | 338°42'53.4" | 

374.9" 1 

63.507 

| 0.3058 

1 

10 | 

3 | 

5 

1 


4 | 322°02'24.7" | 

-8119.3" | -1781.060 

| 0.3197 

1 

HI 

2000 | 

102 

1 


103 | 162°23'50.9" | 

-2065.1" [ - 

110.371 

| 0.4194 

1 

12 | 

102 | 

103 

1 


1 171°57'46.9" 

-236.1" | - 

112.246 

| 0.0317 

1 

13 1 

2001 | 

201 

1 


202 | 263°58'31.6" | 

252.9" | 

104.430 

| 0.0619 

1 

14 

201 | 

202 

1 


203 | 101°52'56. 4" | 

181.4" | 

57.971 

I 0.1493 

1 

15 | 

202 | 

203 

1 


3 | 176°50'15.9" | 

65.9" [ 

23.278 

| 0.1138 

1 

161 

102 | 

2000 

1 


2001 I 109°40'18.6" | 

1764.6" | 

106.331 

| 0.4234 

1 

17 

2000 | 

2001 

1 


201 | 36°07'56.4" | 

210.2" | 

104.450 

| 0.0731 

1 


****** Adjustment Statistics ****** 

Adjustment's Reference Standard Deviation = 487.79 
Rejection Level = 1604.82 
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The proper procedure for removing blunders is to remove the single 
observation that is greater in magnitude than the rejection level selected 
for the adjustment, and is greater in magnitude than the value of any other 
standardized residual in the adjustment. This procedure prevents removing 
observations that are connected to blunders, and thus are inherently affected 
by their presence. By comparing the values of the standardized residuals 
against the rejection level of the adjustment, it can be seen that both a single 
distance (3-4) and angle (3-5-4) are possible blunders since their standardized 
residuals are greater than the rejection level chosen. However, upon inspection 
of Figure 21.6, it can be seen that a blunder in distance 3-4 will directly 
affect angle 3-5-4, and distance 3-4 has the standardized residual that is 
greatest in magnitude. This explains the previous a priori rejection of this 
distance observation. Since distance 3-4 affects the size of angle 3-5-4 in the 
adjustment directly, this angle was also flagged as possible blunder. However, 
its standardized residual is less than that of distance 3-4, and thus only this dis¬ 
tance should be removed from the observations. After removing this distance 
from the observations the adjustment was rerun with the results shown below. 


**** Adjusted Distance Observations **** 

No. | From | To | Distance | Residual | Std. Res. | Red. Num. | 


11 


1 

i 

3 

i 

615.693 | 

-0.047 | 

-2.495 | 


0.7457 | 

2 | 


1 

i 

2 

i 

480.644 | 

-0.066 | 

-3.647 | 


0.6868 | 

3 


1 

i 

3 

i 

615.693 | 

-0.047 | 

-2.495 | 


0.7457 j 

4 | 

2001 

i 

201 

i 

425.902 | 

0.002 | 

0.265 | 


0.1009 | 

5 


3 

i 

6 

i 

201.963 | 

-0.017 | 

-1.032 | 


0.5765 | 

6 | 


3 

i 

5 

i 

410.439 | 

-0.001 | 

-0.032 | 


0.7661 | 

7 


3 

i 

2 

i 

422.684 | 

-0.016 | 

-0.858 | 


0.7314 j 

8 


5 

i 

2 

i 

629.557 | 

-0.023 | 

-1.280 | 


0.6784 | 

9 


5 

i 

1 

i 

450.656 | 

-0.014 j 

-0.858 | 


0.5389 | 

10 


5 

i 

6 

i 

246.590 | 

-0.020 | 

-1.241 j 


0.5519 j 

11 


5 

i 

4 

i 

397.885 | 

-0.005 | 

-0.380 | 


0.4313 | 

12 


5 

i 

3 

i 

410.439 | 

-0.021 j 

-1.082 j 


0.7661 | 

13 

102 

i 

103 

i 

327.298 | 

-0.072 | 

10.380 | 


0.1018 j 

14 

103 

i 

1 

i 

665.751 | 

-0.039 | 

-5.506 | 


0.1049 | 

15 

201 

i 

202 

i 

453.346 | 

0.246 j 

86.073 | 


0.0172 | 

16 | 

202 

i 

203 

i 

709.807 | 

0.027 | 

3.857 | 


0.1049 | 

17 

203 

i 

3 

i 

537.193 | 

0.013 | 

1.922 j 


0.1027 | 

18 | 

2000 

i 

102 

i 

125.101 | 

-0.139 | 

21.759 | 


0.0868 | 







**** Adjusted Angle Observations ** 

*- 


No. | 

From 

i 

Occ 

i 

To 

| Angle 

| Residual 

| Std. Res 

i 

Red. Num. | 

1| 

2 

i 

1 

i 

3 

| 316°47'54.2' 

| -6.3" 

| -1.551 

i 

0.4160 | 

2 | 

2 

i 

3 

i 

4 

167°32'31.0' 

1 3.0" 

0.380 

i 

0.2988 | 

3 

2 

i 

3 

i 

6 

71°42'46. O' 

j -5.5" 

| -0.576 

i 

0.3953 | 

4| 

2 

i 

3 

i 

5 

98°09'18.6' 

1 -17.9" 

| -2.088 

i 

0.6839 | 

5 

2 

i 

3 

i 

1 

51°07'04.r 

| -6.9" 

| -1.360 

i 

0.4978 j 

6 | 

203 

i 

3 

i 

2 

8°59'26.7' 

| -29.3" 

-19.340 

i 

0.0550 | 

7 

2 

i 

5 

i 

3 

| 318°20'51.4' 

| -3.1" 

-0.532 

i 

0.6933 | 

8 

1 

i 

5 

i 

3 

268°50'03.4' 

| 30.9" 

4.353 

i 

0.5282 | 

9 

6 

i 

5 

i 

3 

338°36'37. V 

j -1.4" 

| -0.238 

i 

0.3049 j 

10 

3 

i 

5 

i 

4 

| 324°17'43.6' 

| -0.4" 

| -0.381 

i 

0.0160 | 

H 

2000 

i 

102 

i 

103 

j 162°24'10.2' 

j -2045.8" 

j -109.353 

i 

0.4193 j 

12 

102 

i 

103 

i 

1 

| 171°57'51.2' 

| -231.8" 

| -110.360 

i 

0.0316 | 

13 

2001 

i 

201 

i 

202 

| 263°58'20.3' 

| 241.6" 

99.714 

i 

0.0619 | 

14 

201 

i 

202 

i 

203 

101° 52'34.7' 

| 159.7" 

51.023 

i 

0.1494 | 

15 

202 

i 

203 


3 

176°49'56.1' 

j 46.1" 

16.273 

i 

0.1138 | 

16 | 

102 

i 

2000 

1 2001 

j 109°40'17.7' 

| 1763.7" 

j 106.280 

i 

0.4233 j 

17 j 

2000 

i 

2001 

i 

201 

| 36°07'46.9' 

| 200.7" 

| 99.688 

i 

0.0732 | 




***- 

** 


Adjustment Statistics 

****** 






Adjustment’s 

Reference Standard Deviation 

= 30.62 




Rejection Level = 100.73 
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After this adjustment, analysis of standardized residuals indicates that the 
most likely angles to yet contain blunders are observations 11, 12, and 16. Of 
these, observation 12 containing the previously identified angle 102-103-11 in 
line 12 of the angle observations displays the highest standardized residual. 
Looking at Figure 21.6, it is seen that this angle attaches the northern tra¬ 
verse leg to control station 2000. This is a crucial observation in the network, 
if any hopes of redundancy in the orientation of the network are to be main¬ 
tained. Since this is a flat angle (i.e., nearly 180°), it is possible that the backsight 
and foresight stations were reported incorrectly, which could be checked by 
reversing stations 102 and 1. Flowever, without further field checking, it can¬ 
not be guaranteed that this occurred. A decision must be made ultimately about 
whether this angle should be reobserved. For now, though, this observation will 
be discarded and another adjustment performed. 

In this stepwise blunder detection process, it is always wise to remove as few 
observations as possible. In no case should observations that are blunder free 
be deleted. This can and does happen, however, in stepwise blunder detection 
process. But through persistent and careful processing, only those observa¬ 
tions that contain blunders can be identified and eliminated. The results of the 
adjustment after removing angle 12, are shown below. 

***************** 

Adjusted stations 

* * * * * * * * * * * * * * * * * 


Standard error ellipses computed 


Station 

X 

Y 

Sx 

sy 

Su 

Sv t 

1 

2,477,233.72 

420,353.59 

0.071 

0.069 

0.092 

0.036 133.47" 

2 

2,477,497.89 

419,951.98 

0.050 

0.083 

0.090 

0.037 156.01° 

3 

2,477,832.55 

420,210.21 

0.062 

0.107 

0.119 

0.034 152.80° 

4 

2,477,991.64 

420,400.58 

0.077 

0.121 

0.138 

0.039 149.71° 

5 

2,477,630.43 

420,567.45 

0.088 

0.093 

0.123 

0.036 136.74° 

6 

2,477,665.22 

420,323.32 

0.071 

0.096 

0.114 

0.036 145.44° 

102 

2,476,455.89 

419,741.38 

0.024 

0.018 

0.024 

0.017 80.86° 

103 

2,476,735.05 

419,912.42 

0.051 

0.070 

0.081 

0.031 147.25° 

201 

2,476,576.23 

419,589.23 

0.020 

0.022 

0.024 

0.017 37.73° 

202 

2,476,948.74 

419,331.29 

0.029 

0.041 

0.042 

0.029 14.24° 

203 

2,477,463.84 

419,819.58 

0.040 

0.077 

0.081 

0.032 160.84° 


****************************** 

Adjusted Distance Observations 

* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * 


Station 
Occupied 

Station 

Sighted 

Distance 

V Std.Res. 

Red.# 

2001 

201 

425.88 

-0.023 

-3.25 

0.102 

201 

202 

453.09 

-0.005 

-3.25 

0.006 

202 

203 

709.76 

-0.023 

-3.25 

0.104 

203 

3 

537.16 

-0.023 

-3.25 

0.103 

5 

3 

410.45 

-0.011 

-0.60 

0.767 

5 

4 

397.89 

-0.003 

-0.19 

0.436 

5 

6 

246.60 

-0.014 

-0.83 

0.556 

5 

1 

450.68 

0.013 

0.80 

0.542 

5 

2 

629.58 

0.003 

0.15 

0.678 

3 

2 

422.70 

0.003 

0.16 

0.736 
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3 

1 

615.75 

0.008 

0.40 

0.745 


3 

5 

410.45 

0.009 

0.44 

0.767 


3 

6 

201.97 

-0.013 

-0.78 

0.580 


1 

2 

480.71 

-0.003 

-0.19 

0.688 


1 

3 

615.75 

0.008 

0.40 

0.745 


2000 

102 

125.26 

0.020 

3.25 

0.082 


102 

103 

327.39 

0.023 

3.25 

0.101 


103 

1 

665.81 

0.023 

3.25 

0.104 


*************************** 





Adjusted Angle Observations 





* * * * * * * * * * * *; 

fr********l! 

r***** 





Station 

Station 

Station 





Backsighted 

Occupied 

Foresighted 

Angle 

V 

Std.Res. 

Red.# 

102 

2000 

2001 

109° 11'11.1" 

17.06" 

3.25 

0.042 

2000 

102 

103 

162°58'05.1" 

-10.95" 

-3.25 

0.014 

2000 

2001 

201 

36°04'23.8" 

-2.45" 

-3.25 

0.010 

2001 

201 

202 

263"54'15.7" 

-2.97" 

-3.25 

0.009 

201 

202 

203 

101°49'46.3" 

-8.72" 

-3.25 

0.110 

202 

203 

3 

176°49'01.0" 

-8.98" 

-3.25 

0.109 

203 

3 

2 

8°59'51.1" 

-4.91" 

-3.25 

0.054 

2 

1 

3 

316°48'02.8" 

2.29" 

0.57 

0.410 

3 

5 

4 

324°17'43.8" 

-0.19" 

-0.19 

0.016 

6 

5 

3 

338°36'37.0" 

-1.51" 

-0.26 

0.302 

1 

5 

3 

268°49'43.7" 

11.20" 

1.57 

0.528 

2 

5 

3 

318°20'51.1" 

-3.44" 

-0.59 

0.691 

2 

3 

1 

51"07'14.4" 

3.45" 

0.68 

0.497 

2 

3 

5 

98°09'22.0" 

-14.55" 

-1.71 

0.680 

2 

3 

6 

71°42'48.5" 

-2.97" 

-0.31 

0.392 

2 

3 

4 

167°32'29.5" 

1.48" 

0.19 

0.294 


* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * 

Adjustment Statistics 

**************************************** 

Iterations = 4 
Redundancies = 12 
Reference Variance = 1.316 
Reference So = ±1.1 

Possible blunder in observations with Std.Res. >4.33 
Convergence! 


From analysis of the results above, all observations containing blunders 
appear to have been removed. Flowever, it should also be noted that several 
remaining distance and angle observations have very low redundancy num¬ 
bers. This identifies them as unchecked observations, which is an undesirable 
situation also. Thus, good judgment dictates reobservation of the observations 
deleted. This weakness can also be seen in the size of the standard error ellipses 
for the stations shown in Figure 21.8. 

Note especially the rotation of the error ellipses. That is, the uncertainty is 
primarily in a direction perpendicular to the line to stations 1 and 102. This 
condition was predictable due to the network geometry and since the angle 
102-103-1 had been removed from the data set. Furthermore, the crew on the 
northern leg never observed an angle at station 1, which would tie into station 
103, and thus the position of station 103 was found by the intersection of two 
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FIGURE 21.8 Horizontal least squares option screen shows blunder detection 
options in ADJUST. 


distances that nearly form a straight line. This results in a larger error in the 
direction perpendicular to the lines at this station. 

This example demonstrates the process used to statistically detect and 
remove observational blunders. Whether the observations should be reob¬ 
served depends on the intended use of the survey. Obviously, additional 
observations can strengthen the network and probably reduce the size of the 
error ellipses. However, the geometry of this particular survey lends itself to 
large rotational errors. 

Observations between stations 102 and 201 also contribute to the overall 
strength in the network. However, because a building obstructs that line, these 
observations could not be obtained. Similarly, the network strength could be 
improved if a connection to control east of the survey could be made. However, 
in this case, no reasonable connection to additional control could be made. This 
is a common problem in network design. That is, it is sometimes physically 
impossible to gather observations that would contribute to the total network 
strength. Thus, a compromise must be made between the ideal network and 
what is physically obtainable. Balancing these aspects requires careful planning 
before the observations are collected. Of course, nowadays, poor location of 
control and line obstructions that occur due to terrain, vegetation, or buildings 
can be overcome using GNSS. 
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21.9 SOME FURTHER CONSIDERATIONS 

Equation (21.14) shows the relationship between blunders and their 
effects on residuals as Av,- = —r i A/,-. From this relationship, note that the 
effect of the blunder. A/,, on the residual, Av,-, is directly proportional to the 
redundancy number, r r Therefore, 

1. If r t is large (« 1), the blunder greatly affects the residual and should be 
easy to find. 

2. If I', is small (« 0), the blunder has little effect on the residual and will be 
hard to find. 

3. If r, = 0 as in the case of spur observations, then the blunder is unde¬ 
tectable, and the solved parameters will be incorrect since the error can¬ 
not been detected. 

Since redundancy numbers can range from 0 to 1, it is possible to compute 
the minimum detectable error for a single blunder. For example, suppose that 
a value of 4.0 is used to isolate observational blunders. Then if the reference 
variance of the adjustment is 6, all observations that have standardized 
residuals greater than 24.0 (4.0 x 6) are possible blunders. Flowever, from 
Equation (21.14), it can be seen that for an observation with a redundancy 
number of 0.2 (r, = 0.2) and a standardized residual of Av, = 24.0, the 
minimum detectable error is 24.0/0.2, or 120! Thus, a blunder, Ain this 
observation as large as five times the desired level can go undetected due to its 
low redundancy number. This situation can be extended to observations that 
have no observational checks (spur observations), that is, r t is 0. In this case, 
Equation (21.14) shows that it is impossible to detect any blunder, A/,, in the 
observation since Av, /Ar, is indeterminate. 

With this taken into consideration, it has been shown (Amer, 1983; Caspary, 
1987) that a marginally detectable blunder in an individual observation is 



( 21 . 21 ) 


where A 0 is the mean of the noncentral normal distribution shown in 
Figure 21.5 known as the noncentrality parameter. This parameter is the 
translation of the normal distribution that leads to rejection of the null 
hypothesis and whose values can be taken from nomograms developed by 
Baarda (1968). The sizes of the values obtained from Equation (21.21) provide 
a clear insight into weak areas of the network. 

21.9.1 Internal Reliability 

Internal reliability is found by examining how well observations check 
themselves geometrically. As mentioned previously, if a station is uniquely 
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determined, q u will be zero in Equation (21.21) and the computed value of 
A/j is infinity. This indicates the lack of self-checking observations. Since 
Equation (21.21) is independent of the actual observations, it provides a 
method of detecting weak areas in networks. To minimize the sizes of the 
undetected blunders in a network, the redundancy numbers of the individual 
observations should approach their maximum value of 1. Furthermore, for 
uniform network strength, the individual redundancy numbers, r { , should 
be close to the global relative redundancy of rim where r is the number of 
redundant observations and m is the number of observations in the network. 
Weak areas in the network are located by finding regions where the redundancy 
numbers become small in comparison to relative redundancy. 

21.9.2 External Reliability 

An undetected blunder of size A/, has a direct effect on the adjusted parameters. 
External reliability is the effect of the undetected blunders on these parameters. 
As A/, (a blunder) increases, so will its effect on AX. The value of AAis given by 

AX = (A t WAY 1 A 1 WAe (21.22) 

Again, this equation is datum independent. From Equation (21.22), it can be 
seen that to minimize the value of AX h the size of redundancy numbers must 
be increased. Baarda suggested using average coordinate values in determining 
the effect of an undetected blunder with the following equation 

A = AX t Q xx AX (21.23) 

where A represents the noncentrality parameter. 

The noncentrality parameter should remain as small as possible to mini¬ 
mize the effects of undetected blunders on the coordinates. Note that as the 
redundancy numbers on the observations become small, the effects of unde¬ 
tected blunders become large. Thus, the effect on the coordinates of a station 
from an undetected blunder is greater when the redundancy number is low. In 
fact, an observation with a high redundancy number is likely to be detected as 
a blunder. 

A traverse sideshot (spur observation) can be used to explain this phe¬ 
nomenon. Since the angle and distance to the station are unchecked in a 
sideshot, the coordinates of the station will change according to the size of 
the observational blunders. The observations creating the sideshot will have 
redundancy numbers of zero since they are geometrically unchecked. This 
situation is neither good nor acceptable in a well-designed observational 
system. In network design, one should always check the redundancy numbers 
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of the anticipated observations and strive to achieve uniformly high values for 
all observations. Redundancy numbers above 0.5 are generally sufficient to 
provide well-checked observations. 


21.10 SURVEY DESIGN 

In Chapters 8 and 19, the topic of observational system design was discussed. 
Redundancy numbers can now be added to this discussion. A well-designed 
network will provide sufficient geometric checks to allow observational blun¬ 
ders to be detected and removed. In Section 21.8.1 it was stated that if blunder 
removal is to occur uniformly throughout the system, the redundancy numbers 
should be close to the system’s global relative redundancy. Furthermore, in 
Section 21.8.2 it was noted that redundancy numbers should be about 0.5 
or greater. By combining these two additional concepts with the error ellipse 
sizes and shapes, and stochastic model planning, an overall methodology for 
designing observational systems can be obtained. 

To begin the design process, the approximate positions for stations to be 
included in the survey must be determined. These locations can be determined 
from topographic maps, photo measurements, code-based GNSS, or previous 
survey data. The approximate locations of the control stations should be dic¬ 
tated by their desired locations, the surrounding terrain, vegetation, soils, sight 
line obstructions, and so on. For conventional surveys, held reconnaissance 
at this phase of the design process is generally worthwhile to verify sight-lines 
and accessibility of stations. It is also worthwhile in GNSS surveys to ensure 
adequate sky views are possible from the prospective station locations. At this 
stage, moving a station only a small distance from the original design location 
may greatly enhance visibility, but not change the geometry of the network 
significantly. In conventional surveys, using topographic maps in this process 
allows one to check sight line ground clearances by constructing profiles 
between stations. Additionally, websites such as Google Earth provide easy 
access to recent photography to check overhead visibility clearances in 
GNSS surveys. 

When approximate station coordinates are determined, a stochastic model 
for the observational system can be designed following the procedures dis¬ 
cussed in Chapters 7 and 9. In this design process, considerations should be 
given to the abilities of the held personnel, quality of the equipment, and obser¬ 
vational procedures. After the design is completed, specifications for held crews 
can be written based on these design parameters. These specifications should 
include the type of instrument used, number of turnings for angle observations, 
accuracy of instrument leveling and centering, horizon closure requirements, 
as well as many other items. 
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These items should be written in a form that field crews will understand. 
For example, it is not sufficiently clear to state that the setup error of an instru¬ 
ment must be under ±0.005 ft. It is better to state that level vials and optical 
plummets for all instruments used in the survey must be calibrated, and the 
special care must be taken in setting and leveling instruments over a station. 
If one expects good held work then the instructions to the held crews must be 
understandable and verifiable. 

Once the stochastic model is designed, simulated observations can be 
computed from the station coordinates, and a least squares adjustment of the 
simulated observations performed. Since actual observations have not been 
made, their values are computed from the station coordinates. The adjustment 
will converge in a single iteration with all residuals equaling zero. Thus, the 
reference variance must be assigned the a priori value of 1 to compute the error 
ellipse axes and the standard deviations of the station coordinates. Having 
completed the adjustment, the network can be checked for geometrically weak 
areas, unacceptable error ellipse size or shape, and so on. This inspection 
may dictate the need for any or all of the following: (1) more observations, 
(2) different observational procedures, (3) different equipment, (4) more 
stations, (5) different network geometry, and so on. In any event, a clear 
picture of results obtainable from the observational system will be provided 
by the simulated adjustment and additional observations, or different network 
geometry can be used. 

In GNSS surveys, it should be realized that the design of the network 
provides checks on the observational procedures. However, the accuracy of 
the derived positions is more dependent on the geometry of the satellites, 
the length of the sessions, and the type of processing than it is on the actual 
geometry of the survey. Thus, when designing a GNSS survey, strong con¬ 
siderations should be given to station accessibility, satellite visibility, lack 
of multipath conditions caused by reflective surfaces, positional dilution of 
precision (PDOP), and length of sessions. 

It should be noted that what is expected from the design may not actually 
occur due to numerous and varied reasons. Thus, systems are generally 
overdesigned. However, this tendency to overdesign should be tempered with 
the knowledge that it will raise the costs of the survey. Thus, a balance should 
be found between the design and costs. Experienced surveyors know what 
level of accuracy is necessary for each job and design observational systems 
to achieve the desired accuracy. It would be cost-prohibitive and foolish to 
always design an observational system for maximum accuracy regardless of 
the survey’s intended use. As an example the final adjustment of the survey 
in Section 21.7 had sufficient accuracy to be used in a mapping project with 
a final scale of 1:1200 since the largest error ellipse semimajor axis (0.138 ft) 
would only plot as 0.0014 in. and is thus less than the width of a line on the 
final map product. 
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For convenience, the steps involved in network design are summarized as 
follows: 

Step 1: Using a topographic map, aerial photos, or website, lay out possible 
positions for stations. 

Step 2: Use the topographic map together with air photos to check sight 
lines for possible obstructions and ground clearance. 

Step 3: Do field reconnaissance, checking sight lines for obstructions not 
shown on the map or photos, and adjust positions of stations as necessary. 

Step 4: Determine approximate coordinates for the stations from the map 
or photos. 

Step 5: Compute values of observations using the coordinates from 
step 4. 

Step 6: Using methods discussed in Chapter 6 or 9, compute the standard 
deviation of each observation based on available equipment, and held 
measuring procedures. 

Step 7: Perform a least squares adjustment, to compute observational 
redundancy numbers, standard deviations of station coordinates, and 
error ellipses at a specified percent probability. 

Step 8: Inspect the solution for weak areas based on redundancy numbers 
and ellipse shapes. Add or remove observations as necessary, or reevaluate 
observational procedures and equipment. 

Step 9: Evaluate the costs of the survey, and determine if some other method 
of measurement (GNSS, for example) may be more cost-effective. 

Step 10: Write specifications for held crews. 


21.11 SOFTWARE 

Data snooping and the tau criterion have been implemented in ADJUST for 
differential leveling, horizontal, and GNSS network adjustments. As shown 
in Figure 21.8, the user can implement either option by selecting it. Once 
selected, a text box will appear to the right of the option, which defaults to an 
appropriate rejection criterion. For example, when data snooping is selected, 
the default rejection level is 3.29. The default level of signihcance for the tau 
criterion is 0.001. The user may modify these defaults to suit their situation. 
As discussed in Section 21.8, the software will compute the standardized 
residuals and the redundancy numbers for each observation. Additionally, 
this option should be selected when performing a simulated adjustment so 
that the redundancy numbers can be scanned for observations that lack 
sufficient checks. 
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Compute Qw for blunder detection 

Qw : = W *‘-Qn 

Compute standardized residuals and redundancy numbers 
i := 0 . nobs — 1 

M 

SVj :=- 1 1 Standardized residuals 

^ = Qwj '.* Redundancy numbers 

FIGURE 21.9 Mathcad code to compute standardized residuals and redundancy 
numbers. 


On the book’s companion website is the Mathcad hie C21.xmcd that 
demonstrates the statistical blunder detection concepts covered in this chapter. 
Figure 21.9 shows the section of the Mathcad code that is used to compute 
the standardized residuals and redundancy numbers. For those wishing to 
program blunder detection using a higher-level language, the Mathcad hie 
C21.xmcd demonstrates the use of blunder detection in analyzing a horizontal 
network. Furthermore, the computation of the critical tau value has been 
added to the program STATS. Both of these programs can be found on the 
book’s companion website. 

PROBLEMS 

Note: ADJUST, which is available on the book’s companion website 
should be used to solve the problems requiring a least squares adjustments. 
Partial answers are provided for problems marked with an asterisk in 
Appendix FI. 

*21.1 Discuss the effects of a distance blunder on a traverse closure and 
explain how it can be identihed. 

21.2 Discuss the effects of an angle blunder on a traverse closure, and 
explain how it can be identihed. 

21.3 Explain why it is not wise to have observational redundancy numbers 
near 0 in a well-designed network. 




PROBLEMS 491 


21.4 Create a list of items that should be included in held specifications for 
a crew in a designed network and then create a sample set of specifi¬ 
cations for a horizontal survey. 

21.5 Summarize the general procedures used in isolating observational 
blunders. 

21.6 How are control problems isolated in an adjustment? 

21.7 Discuss possible causes for control problems in an adjustment. 

21.8 Why is it recommended that there be at least three control stations in 
a least squares adjustment? 

21.9 Outline the procedures used in survey network design. 

*21.10 Using data snooping, analyze the data in Problem 15.10. Hold the 
control fixed during the adjustment. 

21.11 Repeat Problem 21.10 using the tau criterion. 



FIGURE P21.ll 


21.12 Analyze the data in Problem 16.8 using 

(a) Data snooping. 

(b) Tau criterion. 

21.13 Using data snooping, analyze the data in Problem 15.12 for blunders. 
Hold the control fixed during the adjustment. 

21.14 Analyze the data in Problem 15.15 while holding the control station 
coordinates fixed using 

(a) data snooping. 

(b) tau criterion. 
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FIGURE P21.14 


21.15 Analyze the data in Problem 16.14 while holding the control station 
coordinates fixed using 

(a) data snooping. 

(b) tau criterion. 

*21.16 Two control stations that are 12,203.02 ft apart have a published pre¬ 
cision of 1:50,000. What are the appropriate estimated errors for the 
coordinates of these points? 

21.17 Repeat Problem 21.16 for two stations that are 40,503.645 m apart 
with a published precision of 1:20,000. 

21.18 Analyze the data in Problem 16.7 assuming the control points have 
relative precisions of 1:10,000 using 

(a) data snooping. 

(b) tau criterion. 

21.19 The standard deviations on the xy coordinates for Station A in 
Problem 16.14 are ±0.016 ft and ±0.020 ft, respectively. The standard 
deviations for Station D are ±0.028 ft and ±0.022 ft. Adjust and 
analyze the data. Be sure to handle the control correctly. 

21.20 In the accompanying figure, the following data were gathered. Assum¬ 
ing that the control stations have a published precision of 1:10,000, 
apply the procedures discussed in this chapter to isolate and remove 
any apparent blunders in the data. 

(a) Use data snooping with a rejection criterion of 3.29. 

(b) Use the tau criterion at a level of significance of 0.001. 

(c) Analyze statistically the constrained and minimally constrained 
adjustments. Did the two adjustments pass the Utest at a level of 
significance of 0.05? 

(d) At a level of significance of 0.05, does the constrained adjustment 
pass the y 2 test? 
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Control Stations Approximate Station Coordinates 


Station Easting (m) Northing (m) Station Easting (m) Northing (m) 


A 

D 

1105.687 

4609.645 

1000.204 

256.789 

B 3205.687 

C 1597.600 

E 1597.600 

F 2814.698 

1602.593 

200.000 

200.000 

842.358 

Distance Observations 

From 

To 

Distance (m) S (m) 

From To 

Distance (m) S (m) 

A 

B 

2184.688 

0.008 

E F 

1376.207 

0.006 

A 

F 

1716.281 

0.007 

E A 

939.301 

0.005 

B 

C 

1527.384 

0.006 

D F 

1888.046 

0.007 

B 

F 

854.876 

0.005 

D E 

3012.591 

0.010 

C 

D 

741.819 

0.005 

C F 

1800.671 

0.007 

Angle Observations 





Backsight 

Occupied 

Foresight 

Angle 

SO 


F 


A 

E 

53°08'33.6" 

2.3 


B 


A 

F 

21°16'55.2" 

2.2 


F 


B 

A 

46°46'38.5" 

2.3 


C 


B 

F 

93°55'23.9" 

2.3 


F 


C 

B 

28°16'35.8" 

2.2 


D 


C 

F 

85°06'21.2" 

2.3 


F 


D 

C 

71°50'57.6" 

2.3 


E 


D 

F 

19°08'51.8" 

2.2 


A 


E 

F 

93°45'22.8" 

2.3 


F 


E 

D 

26°44'36.3" 

2.2 


A 


F 

B 

111°56'25.0" 

2.3 


B 


F 

C 

57°48T9.5" 

2.3 


C 


F 

D 

23°02'45.8" 

2.2 


D 


F 

E 

134°06'27.3" 

2.2 


E 


F 

A 

33°06'04.7" 

2.2 
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21.21 Repeat Problem 21.20 with the additional distance observations. 
Comment on any changes in the redundancy numbers of the 
observations. 


From 

To 

Length (m) 

5(m) 

C 

B 

1527.379 

0.006 

F 

B 

854.888 

0.005 

D 

C 

741.813 

0.005 

F 

E 

1376.203 

0.006 

A 

E 

939.320 

0.005 


21.22 Apply to procedures discussed in this chapter to isolate any blunders 
in the following data. Assume that station A has a relative precision 
of 1:100,000 and H has a relative precision of 1:50,000. 

(a) Analyze the data using data snooping using a rejection criterion 
of 3.29. 

(b) Analyze the data using the tau criterion at a level of significance 
of 0.001. 

(c) Analyze statistically the constrained and minimally constrained 
adjustments. Did the two adjustments pass the Ftest at a level of 
significance of 0.05? 

(d) At a level of significance of 0.05, does the constrained adjustment 
pass the / 2 test? 


Control Stations Approximate Coordinates 


Station 

A (ft) 


Station 

A (ft) 

Y (ft) 

A 

45,806.98 

80,465.38 

B 

36,489.48 

151,309.33 

H 

147,608.99 

202,654.36 

C 

49,263.50 

202,648.34 




D 

98,056.35 

153,648.04 




E 

99,121.34 

76,098.35 




F 

144,512.87 

74,215.66 




G 

150,608.77 

142,516.35 

Distance Observations 

Course 

Distance (ft) 

S (ft) 

Course 

Distance (ft) S (ft) 

AB 

71,454.13 

0.215 

BC 

52,904.31 

0.159 

CD 

69,150.62 

0.208 

DE 

77,557.09 

0.233 

EF 

45,430.65 

0.137 

EG 

68,571.96 

0.206 

GH 

60,212.72 

0.181 

CH 

98,345.84 

0.295 

AE 

53,492.61 

0.161 

AD 

89,920.33 

0.270 

DH 

69,692.94 

0.210 

BD 

61,611.51 

0.185 

DG 

53,718.64 

0.162 

DF 

92,022.35 

0.276 
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Angle Observations 


Backsight 

Occupied 

Foresight 

Angle 

so 

B 

A 

D 

43°01'02.7" 

2.1 

D 

B 

A 

84°40'58.5" 

2.1 

C 

B 

D 

73°51'06.5" 

2.1 

D 

C 

B 

58°51'02.5" 

2.1 

H 

C 

D 

45°07 / 31.2" 

2.1 

D 

H 

C 

44°40'44.3" 

2.1 

G 

H 

D 

48°10 / 24.0" 

2.1 

D 

G 

H 

75°ll / 06.6" 

2.1 

F 

G 

D 

96°51'34.3" 

2.1 

D 

F 

G 

35°25'18.1" 

2.1 

E 

F 

D 

57°18'12.4" 

2.1 

A 

E 

D 

84°31'49.4" 

2.1 

D 

E 

F 

93°09'44.6" 

2.3 

D 

A 

E 

59°09 / 26.9" 

2.1 

A 

D 

B 

52°18 / 00.4" 

2.1 

B 

D 

C 

47°17 / 50.0" 

2.1 

C 

D 

H 

90°1 F45.9" 

2.1 

H 

D 

G 

56°38'30.7" 

2.1 

G 

D 

F 

47°43'04.5" 

2.1 

F 

D 

E 

29°32'07.2" 

2.1 

E 

D 

A 

36°18'39.8" 

2.1 


21.23 Using the data set Blunder.dat, which is part of the installation of the 
software ADJUST that accompanies this book, isolate any blunders 
that are detectable using data snooping and a rejection criteria of 3.29. 

21.24 Repeat Problem 21.23 using the tau criterion and a level of significance 
of 0.001. 

21.25 As shown in the accompanying figure, the following approximate 
station coordinates were determined from a map of an area where a 
second-order, class I survey (1:50,000) is to be performed. All sight 
lines to neighboring stations have been checked and are available 
for conventional observations of distances, angles, and azimuths. 
The control stations are visible to their nearest neighbors. Design 
a control network that will meet the specified accuracy at a 95% 
confidence level and have sufficient checks to ensure the reliability of 
the results. Stations J218, J219, and ROCK are first-order control 
stations (1:100,000). 
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Control Stations 


Station 

X(m) 

Y (m) 

J218 

283,224.223 

116,202.946 

J219 

154,995.165 

330,773.314 

ROCK 

521,287.251 

330,276.310 


Approximate Station Locations 


Station 

U(m) 

Y (m) 

101 

280,278 

194,109 

102 

276,350 

278,887 

103 

360,147 

121,768 

104 

356,219 

195,090 

105 

352,291 

274,304 

106 

455,728 

132,570 

107 

446,563 

198,036 

108 

440,671 

270,700 


PRACTICAL PROBLEMS 

21.1 Design a 6 mile by 6 mile control network having a minimum of eight 
control stations using a topographic map of your local area. Design a 
traditional measurement network made up of angles, azimuths, and 
distances so that the largest ellipse axis at a 95% confidence level is 
less than 0.20 ft and so that all observations have redundancy num¬ 
bers greater than 0.5. In the design, specify the shortest permissible 
sight distance, the largest permissible errors in pointing, reading, 
and instrument and target setup errors, the number of repetitions 
necessary for each angle measurement, and the necessary quality of 
angle and distance measuring instruments. Use realistic values for 
the instruments. Plot profiles of sight lines for each observation. 

21.2 Design a 6 mile by 6 mile GNSS control network to be established by 
differential GNSS that has a minimum of eight control stations using a 
topographic map of your local area to select station locations. Design 
the survey so that all baseline observations included in the network 
have redundancy numbers greater than 0.5. In the design, use a unit 
matrix for the covariance matrix of the baselines. 








CHAPTER 22 


THE GENERAL LEAST SQUARES 
METHOD AND ITS APPLICATION TO 
CURVE FITTING AND COORDINATE 
TRANSFORMATIONS 


22.1 INTRODUCTION TO GENERAL LEAST SQUARES 

When fitting points to a straight line it must be recognized that both the 
x and y coordinates contain errors. Yet in the mathematical model presented 
in Section 11.11.1, the residuals, as illustrated in Figure 11.2 are only applied 
to the y coordinate. Because both coordinates contain errors, this mathemat¬ 
ical model fails to account for the x coordinate being an observation. In this 
chapter, the general least squares method is presented, and its use in perform¬ 
ing adjustments where the observation equations involve more than a single 
observation is demonstrated. 


22.2 GENERAL LEAST SQUARES EQUATIONS FOR FITTING 
A STRAIGHT LINE 

Consider the data illustrated in Figure 11.2. To account properly for both the 
x and y coordinates being observations, the observation equation must contain 
residuals for all observations. That is. Equation (11.40) must be rewritten as 

F(x,y) = (y + v y ) - m(x + v x ) - b = 0 (22.1) 

In Equation (22.1), x and y are a point’s coordinate pair with residuals v x and 
v, respectively, m is the slope of the line, and his the y intercept. Equation (22.1) 
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contains v x , v’ m, and b as unknowns and is nonlinear. Thus, its solution 
is obtained by using the methods outlined in Section 11.10. The resulting 
linearized form of Equation (22.1) is 


dF dF dF , dF „ , , ^ 

—v.. + — v v + -—am + —db = -{m () x + b 0 - y) (22.2) 

ox dy y dm db 


where the partial derivatives are 


dF _ dF _ i dF 

dx dy dm 


dF . 
-x —- = -1 
db 


(22.3) 


For the four data points A, B, C, and D , substituting into Equations (22.3) 
into (22.2) the following four equations can be written 


~ m o v x A + v yA - x A dm — db = —(m 0 x A + b 0 - y A ) 
~ m o v x B + v y B ~ - db = ~(m 0 x B + b 0 - y B ) 

~> n 0 V x c + v y c ~ x c dm ~ db = ~( m o x c + b o ~ Tc) 
-> n o v x D + v y D - x D dm - db = -0n o x D + b 0 - y D ) 

In matrix form, Equations (22.4) can be written as 


(22.4) 


BV + JX = K 


(22.5) 


where 


B = 


-m 0 

1 

0 

0 

0 

0 

0 

0" 


~ X A 

-f 

0 

0 

o 

1 

0 

0 

0 

0 

J = 

~ X B 

-1 

0 

0 

0 

0 

-mo 

1 

0 

0 

~ X C 

-1 

0 

0 

0 

0 

0 

0 

-m 0 

0 


~ X D 

-1 


V ■ 


V *A 

V Va 

V *B 

V >'b 

V *c 

V Tc 

V -z> 


X ■ 


dm 

db 


K- 


-(m 0 x A + b 0 - y A ) 
-(m 0 x B + b 0 - y B ) 
-(m 0 x c + b 0 - y c ) 
<m 0 x D + b 0 - y D ) 


( 22 . 6 ) 


Now since both x and y are observed coordinates, they can have individual 
estimated standard errors. Assuming that the coordinates are from indepen¬ 
dent observations, the four points will have eight observed coordinates and a 
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cofactor matrix of 


Q = 


g 2 a 0 0 0 

O '" c) a 0 0 

0 o' g 2 Xb 0 

0 0 0 a 2 

o o o o B 

0 0 0 0 

0 0 0 0 

0 0 0 0 


0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

<J 2 XC 0 0 0 

0 a 2 c 0 0 

0 0 g 2 d 0 

0 0 0 Gy 

yD 


22.3 GENERAL LEAST SQUARES SOLUTION 

In solving the general least squares problem, an equivalent solution is achieved. 
For this solution, the following equivalent weight matrix is created for the 
system 

W e = ( BQB r )~ l (22.7) 

where B is as defined in Equation (22.6). Using the equivalent weight matrix in 
Equation (22.7), the equivalent matrix system is 

J r W e JX = J T W e K (22.8) 

Equation (22.8) has the solution 

X = (/ T W e J)~ l J T W e K (22.9) 

Since this is a nonlinear equation system, the corrections in matrix X are 
applied to the initial approximations, and the method is repeated until the sys¬ 
tem converges. The equivalent residuals vector V e is found following the usual 
procedure of 

V e = JX - K (22.10) 

Using Equation (22.10), the observational residuals are 

V = QB J W e V e (22.11) 

Also, since this is a nonlinear problem and the observations are being 
adjusted, the observations should also be updated according to their residuals. 
Thus, the updated observations for the second iteration are 


?i = h + v, 


( 22 . 12 ) 
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where /' are the second iterations observations, I I the previous iteration’s 
observations, and v, the observations corresponding residuals. Generally, in 
practice the original observations are “close” to their final adjusted values, 
and thus Equation (22.12) is not actually used since the second iteration is 
only a check for convergence. 

Finally, the reference variance for the adjustment can be computed using the 
equivalent residuals and weight matrix employing the equation 

V T W V 

S 2 = _e -(22.13) 

u y 


where r is the number of redundancies in the system. It should be noted that 
the same results can be obtained using the observational residuals and the fol¬ 
lowing expression. 

-,2 v T wv 


S o = 


(22.14) 


Example 22.1 Numerical Solution of the Straight-Line-Fit Problem 

Recall the least squares fit of points to a line in Section 11.11.1. In that 
example, the observed coordinate pairs were 


A: (3.00,4.50) B: (4.25,4.35) C: (5.50,5.50) D\ (8.00,5.50) 


The solution for the slope of the line, m, and y intercept, b, were 

m = 0.246 
b =3.663 


(a) 


Additionally, the residuals were 


V=AX-L= 


- 0.10 

0.46 

-0.48 


0.13 


Now, this problem will be solved using the general least squares method. 
Assume that the following covariance matrix is given 


0 . 020 2 0 0 0 0 0 0 0 

0 0.015 2 0 0 0 0 0 0 

0 0 0.023 2 0 0 0 0 0 

0 0 0 0.036 2 0 0 0 0 

0 0 0 0 0.033 2 0 0 0 

0 0 0 0 0 0.028 2 0 0 

0 0 0 0 0 0 0.016 2 0 

0 0 0 0 0 0 0 0.019 2 
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SOLUTION The step-by-step procedure for solving this problem using 
general least squares follows. 

Step 1: Compute the initial approximations. Initial approximations for both 
m and b are found by using two points and solving the unique system. 
For this example, the values from the solution of Section 11.11.1 as given 
above will be used. It is often the case where the standard least squares 
methods discussed in Chapter 11 are used to determine the initial approx¬ 
imations for the general least squares adjustment. 

Step 2: Develop the appropriate matrices. In accordance with Equation 
(22.6), the B matrix is 


B = 


-0.246 1 

0 0 

0 0 

0 0 


0 0 

-0.246 1 

0 0 

0 0 


0 0 

0 0 

-0.246 1 

0 0 


0 0 

0 0 

0 0 

-0.246 1 


Using Equation (22.7), the equivalent weight matrix is 





2.5 

0 

0 

0 


(BQB'y 

-l _ 

1 

0 

13.3 

0 

0 



10,000 

0 

0 

8.5 

0 





0 

0 

0 

3.8 


[4012.7 

0 

0 


0 



0 

753.0 0 


0 



0 

0 

1176.6 

0 



0 

0 

0 


2656.1 






Step 3: Solve the system. The first iteration corrections are found using 
Equation (22.9) as 


X = ( J T W e J)~ l J T W e K = 


-0.0318 

0.1907 


where the J, K, and J r W J matrices for the first iteration were 



-3.00 -1 


'0.246(3.00)+ 3.663 -4.50' 


-0.099 

J = 

-4.25 -1 
-5.50 -1 

K = 

0.246(4.25) + 3.663 - 4.25 
0.246(5.50)+ 3.663 - 5.50 

= 

0.458 

-0.484 


-8.00 -1 


0.246(8.00) + 3.663 - 5.50 


0.131 


255,297.91 42,958.45 
42,958.45 8598.40 


J T W e K = 


72.9737 

273.5321 
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Step 4: Apply the corrections to m 0 and b 0 to update the initial approxima¬ 
tions for the second iteration, 

m = 0.246 - 0.0318 = 0.2142 
b = 3.663 + 0.1907 = 3.8537 


Second Iteration. During the second iteration, only the unknown parameters 
are updated, and thus only B, W e , and K matrices differ from their first iteration 
counterparts. Their second iteration values are 



'-0.2142 

1 

0 

0 

0 

0 

0 

B = 

0 

0 - 

-0.2142 

1 

0 

0 

0 

0 

0 

0 

0 -0.2142 

1 

0 


0 

0 

0 

0 

0 

0 

-0.2142 


'4109.3 

0 

0 

0 



-0.00370 

w e = 

0 

757.4 

0 

0 

K 


0.51405 

0 

0 

199.1 

0 

— 

-0.46820 


0 

0 

0 

2682.8 



0.06730 


The corrections after this iteration are 

[0.00002 

X ~ 0.00068 


Thus, m and b are 0.214 and 3.854 to three decimal places. Using 
Equation (22.10), the equivalent residual vector is 


V. 


-0.0030 

0.5148 

-0.4674 

0.0681 


Using Equation (22.11), the observational residuals are 


V=QB J W e V e = 


0.0010 

-0.0027 

-0.0442 

0.5053 

0.1307 

-0.4394 

- 0.0100 

0.0660 


A graphical interpretation of the residuals is shown in Figure 22.2. Notice 
how the equivalent residuals are aligned with the v-axis, and that the observa¬ 
tional residuals exist in the cardinal x and y axes directions. These residuals are 
shown more clearly in Figure 22.2, which is an enlarged view of the portion of 
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Figure 22.1 that surrounds point C. The equivalent residual of C is -0.4674 
from the line, and the observational residuals v y = 0.1307 and v„ = -0.4394 
are parallel to the x and y axes, respectively. This general solution is more 
appropriate for adjusting the actual coordinate observations. Note that this 
solution is slightly different from that determined previously in Example 11.3. 

y 

A 



FIGURE 22.1 General least squares fits of points to a line. 


T r 


c 


- 0.4674 - 0.4394 

' i-J 


' 0.1307 

FIGURE 22.2 Residuals for point C. 
Using Equation (22.13), the reference standard deviation is 


S 0 = 


475.2 

4-2 


= ±15.4 


22.4 TWO-DIMENSIONAL COORDINATE TRANSFORMATION 
BY GENERAL LEAST SQUARES 

As was presented in Chapter 18, two-dimensional coordinate trans¬ 
formations are commonly used to convert points from one two-dimensional 
coordinate system to another. Again, the general least squares method is a 
more appropriate method for these transformations since the coordinates in 
both systems are observations that contain errors. 

22.4.1 Two-Dimensional Conformal Coordinate Transformation 

The two-dimensional conformal coordinate transformation, presented in 
Chapter 18, has four unknowns, consisting of a scale factor, rotation angle, 
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and two translations. Equations (18.5) express this transformation, and they 
are repeated here for convenience. The transformation equations are 


X = ax — by + c 
Y = bx + ay + d 

Equations (22.15) can be rearranged as 

F: ax-by + c - X = 0 
G : bx + ay + d — Y = 0 


(22.15) 


(22.16) 


Since the coordinates from both the xy and XY systems contain errors, 
Equations (22.16) are rewritten as 


F (x, y, X, Y) = a(x + v x ) - b(y + v v ) + c - (X + v x ) = 0 

(22.17) 

G(x, y, X, Y) = b(x + v x ) + a(y + v y ) + d - (Y + v r ) = 0 

These equations are nonlinear in terms of their observations and residuals. 
They are solved by linearizing the equations and iterating to a solution. The 
partial derivatives with respect to each unknown are 


dF _ a dF _ ^ dF 

~dx ~ U dy ~ ~ dX 

dF _ dF _ dF 

da db ' dc 

Using the partial derivatives in Equation (22.18), a matrix for each point can 
be built as 


1 — b — a — 1 

dx dy dY 


1 


dG 


dG 


dG _ 

da ' db dd 


(22.18) 


1 


«o ~ b o -1 
b 0 a 0 0 


0 

-1 


U 

v y 

Vx 


+ 


X 

y 


-y 

X 


1 

0 


da 

db 

dc 

dd 


X - (a 0 x + b 0 y + T x ) 
Y - (b 0 x + a 0 y + T y ) 


(22.19) 


For a redundant system, the matrices are solved following the matrix proce¬ 
dures outlined in Section 22.3. 

Example 22.2 Four fiducial points are digitized from an aerial photo, 
and their observed (x, y) and control (X, Y) values are listed in Table 22.1. 
The standard deviations of these observations are also listed. What are the most 
probable values for the transformation parameters and the resulting residuals? 
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TABLE 22.1 Data for a Two-Dimensional Conformal Coordinate Transformation 


Point 


Y±Sy 

x±s x 

y±s y 

1 

-113.000 ±0.002 

0.003 ± 0.002 

0.7637 ± 0.026 

5.9603 ± 0.028 

3 

0.001 ± 0.002 

112.993 ±0.002 

5.0620 ± 0.024 

10.5407 ± 0.030 

5 

112.998 ±0.002 

0.003 ± 0.002 

9.6627 ± 0.028 

6.2430 ± 0.022 

7 

0.001 ± 0.002 

-112.999 ±0.002 

5.3500 ± 0.024 

1.6540 ±0.026 


SOLUTION In this problem, initial approximations for a, b, c, and d must 
first be computed. These values can be found using a standard least squares 
adjustment, or by solving the system with only two points. The former proce¬ 
dure was demonstrated in Example 18.1. Using standard least squares, initial 
approximations for the parameters are determined to be 


a 0 = 25.386458 
= -0.8158708 
c 0 = -137.216 
d 0 = -150.600 


Now the B, Q, J, and K matrices described in Section 22.3 can be formed. 
They are listed below (note that the numbers are rounded to three decimal 
places for publication purposes only): 

B = 


.386 0.816 

-1 0 


0 0 

0 0 

0 

0 

0 

0 

0 

0 

0 

0 

.816 25.386 

0 -1 


0 0 

0 0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 0 

25.386 0.816 

-1 0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 0 

- 0.816 25.386 

0 -1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 0 


0 0 

0 0 25.386 

0.816 

-1 

0 

0 

0 

0 

0 

0 

0 

0 0 


0 0 

0 0 - 0.816 

25.386 

0 

-1 

0 

0 

0 

0 

0 

0 

0 0 


0 0 

0 0 

0 

0 

0 

0 

25.386 

0.816 

-1 

0 

0 

0 

0 0 


0 0 

0 0 

0 

0 

0 

0 

- 0.816 

25.386 

0 

-1 

' 0.764 


- 5.960 

1 

o " 


- 0.03447270 









5.960 


0.764 

0 

1 


- 0.08482509 









5.062 

- 

10.541 

1 

0 


0.11090026 









10.541 


5.062 

0 

1 

K = 

0.13190015 









9.663 


- 6.243 

1 

0 


- 0.18120912 









6.243 


9.663 

0 

1 


- 0.00114251 









5.350 


- 1.654 

1 

0 


0.04999940 









1.654 


5.350 

0 

1 


- 0.02329275 
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Also, the Q matrix is 


Q = 
0 . 026 2 


0 . 028 2 


0 . 002 2 


0 . 030 2 


0 . 002 2 


0 . 002 2 


0 . 002 2 


0 . 024 2 


0 . 026 2 


The solution for the first iteration is 

-0.000124503 

-0.000026212 

-0.000325016 

-0.000029546 

Adding these corrections to the initial approximations, gives: 

a = 25.38633347 
* = -0.815897012 
c = -137.2163 
d = -150.6000 


In the next iteration, only minor corrections occur, and thus the system has 
converged to a solution. The residuals and reference variance are computed 
as before. Although the solution has changed slightly from the standard least 
squares method, it properly considers the fact that each observation equation 
contains four observations. Of course, once the transformation parameters 
have been determined, any points that exist only in the xy system can be 
transformed into the XY system by substitution into Equations (22.15). 
This part of the problem is not demonstrated in this example. In fact, 
for the remainder of the chapter, only the adjustment model will be 
developed. 








22.4 TWO-DIMENSIONAL COORDINATE TRANSFORMATION BY GENERAL LEAST SQUARES 507 


22.4. 2 Two-Dimensional Affine Coordinate Transformation 

As discussed in Section 17.5, the main difference between conformal and 
affine transformations is that the latter allows for different scales along the 
x and y axes, and also accounts for nonorthogonality in the axes. This results 
in six parameters. Equations (18.9) express the affine transformation, and they 
are repeated here for convenience. 


X = ax + by + c 
Y = dx + ey+f 


( 22 . 20 ) 


Equation (22.20) can be rewritten as 

F(x, y, X, Y) = ax + by + c - X = 0 
G(x, y, X, F) = dx + ey+f - Y = 0 


( 22 . 21 ) 


Again, Equation (22.21) consists of observations in both the x and y coordi¬ 
nates, and thus it is more appropriate to use the general least squares method. 
Therefore, these equations can be rewritten as 


F(x, y, X , F) = a(x + v x ) + b(y + v y ) + c - (X + v A ) = 0 
G(x, y, X, F) = d(x + v x ) + e(y + v y ) +f - (F + v F ) = 0 


For each point, the linearized equations in matrix form are 


o 0 b 0 -1 
do e o 0 


0 

-1 



V* 

r 


V v 



y 

+ 


Vx 



, V Y_ 



y 1 0 0 
0 0 x y 


da 

db 

dc 

dd 

de 

df 


X - (a 0 x + b 0 y + c 0 ) 
F - (d 0 x + e 0 y +/ 0 ) 


( 22 . 22 ) 


(22.23) 


Two observations equations, like those of Equation (22.23), result for each 
control point. Since there are six unknown parameters, three control points are 
needed for a unique solution. With more than three, a redundant system exists, 
and the solution is obtained following the least squares procedures outlined in 
Section 22.3. 


22.4.3 Two-Dimensional Projective Transformation 

The two-dimensional projective coordinate transformation converts a projec¬ 
tion of one plane-coordinate system into another nonparallel plane system. 
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This transformation was developed in Section 18.6. Equations (18.12) for this 
transformation are repeated here for convenience. 


a x x + b x y + Cj 
a 3 x + b 3 y + 1 
a 2 x + b 2 y + c 2 
a 3 x + b 3 y + 1 


(22.24) 


Unlike the conformal and affine types, this transformation is nonlinear in 
its standard form. In their general form, the projective equations become 


a l (x + v x ) + b l {y + v) + c l 

F(x,y, X, Y ) = ' . ^ J . . ~(X + v x ) = 0 

a 3 (x + v x ) + b 3 (y + v y ) + 1 

a-,(x + v x ) + b 2 (y + v ) + c 2 

G(x,y,X,Y)= - \ / y ~ -(Y + v y ) = 0 (22.25) 

a 3 (x + v Y ) + b 3 (y + v ) + 1 


Again, a linearized form for Equations (22.25) is needed. The partial deriva¬ 
tives for the unknown parameters were given in Section 18.6, and the remaining 
partial derivatives are given below. 


dF _ 

a i(b 3 y + l)-a 3 (*tJ' + c 1 ) 

dF 

dx 

(a 3 x + b 3 y+ l ) 2 

dy 

dG _ 

a 2 (b 3 y + 1 ) - a 3 (b 2 y + c 2 ) 

dG 

dx 

(a 3 x + b 3 y + l ) 2 

dy 


b { (a 3 x + 1 ) - b 3 (a x x + cq) 
(a 3 x + b 3 y + l ) 2 
b 2 (a 3 x + 1 ) - b 3 (a 2 x + c 2 ) 
(a 3 x + b 3 y + 1 ) 2 


In matrix form, the linearized equations for each point are 


'dF 

dF 

dx 

dy 

dG 

dG 

_ dx 

dy 



"u" 


V T 




_ V Y_ 


" dF dF 
dcii db\ 

0 0 


dF_ 

dc l 

0 


0 0 

dG_ dG_ 
da 2 db 2 


0 

dG 

dc 2 


dF 

da 3 

dG_ 

da 3 



da x 


db x 

dF 1 


dc { 

db 3 


da~, 

dG 


db 2 

db 


dc 2 


da 3 


db 3 


(22.26) 


Equation (22.26) gives the observation equations for the two-dimensional 
projective transformation for one control point, and the K matrix is defined 
in Equation (18.13). Since there are eight unknown parameters, four control 



















22.5 THREE-DIMENSIONAL CONFORMAL COORDINATE TRANSFORMATION 509 


points are needed for a unique solution. More than four control points 
yields a redundant system that can be solved following the steps outlined in 
Section 22.3. 


22.5 THREE-DIMENSIONAL CONFORMAL COORDINATE 
TRANSFORMATION BY GENERAL LEAST SQUARES 

As explained in Section 18.7, this coordinate transformation converts 
points from one three-dimensional coordinate system to another. Equations 
(18.15) express this transformation, and the matrix form of those equations is 

X = SRx + T (22.27) 

where the individual matrices are as defined in Section 18.7. 

Equation (18.15) gives detailed expressions for the three-dimensional 
coordinate transformation. Note that these equations involve six observations, 
xyz and XYZ. In the general least squares method, these equations are 
rewritten as 


F{x,y, z, X,Y,Z) = S[r n (x + v x ) + r 21 (y + v v ) + r 31 (z + v_)] + Tx - (X + v x ) = 0 
G(x, y, z, X, Y, Z) = S[r 12 (x + v x ) + r 22 (y + v 3 .) + r 3 ,(z + v_)] + Ty - {Y + v Y ) = 0 
H{x,y, z, X, Y, Z) = S[r 13 (x + v v ) + r 23 (y + v y ) + r 33 (z + v,)] + Tz - (Z + v z ) = 0 

( 22 . 28 ) 

Equations (22.28) are for a single point and again, they are nonlinear. They 
can be expressed in linearized matrix form as 


'dF 
dx 
dG 
dx 
d_H_ 
. dx 


dF dF dF 
dy dz dX 
dG dG 
dy dz 

dH_ dH_ o 

dy dz 


0 

dG 
dY 

o d JL 

dZ 



V* 


v y 


Vz 


Vjr 


v y 


v z 


+ [Equation (18.6)] 


(22.29) 


where 


dF 

= Sr n 

dF 

~ S y 2\ 

dF 

II 

Co 

U) 

dF _ 

-1 

dx 

dy 

dz 

dX ~ 

dG 

= Sr n 

dG 

= Sr 22 

dG 

- *^ r 32 

dG _ 

-1 

dx 

dy 

dz 

dY ~ 

dH 

II 

Co 

"*3 

UJ 

dH 

II 

to 

dH 

= Sr 3 2 

dH _ 

-1 

dx 

dy 

dz 

dZ ~ 


The remaining partial derivatives were given in Equation (18.6) of Section 
18.7. This system is solved using the methods discussed in Section 22.3. 
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Example 22.3 Estimated errors were added to the control coordinates in 
Example 18.4. The control data are repeated in Table 22.2 and standard devi¬ 
ations of the control coordinates, needed to form the Q matrix, are also listed. 
Following Table 22.2, output from the program ADJUST is listed. The hie 
Example 22-3.dat on the book’s companion website uses the same format 
as was described in Example 18.4. Elowever, in hies using the general least 
squares method, standard deviations can be given for the control coordinates 
also. Note that this solution differs slightly from the one obtained by standard 
least squares in Example 18.4. 


TABLE 22.2 Control Data for Three-Dimensional Conformal Coordinate 
Transformation 


Point 

X 

Y 

z 

S* 

Sy S z 

1 

10,037.81 

5262.09 

772.04 

0.05 

0.06 0.05 

2 

10,956.68 

5128.17 

783.00 

0.04 

0.06 0.09 

3 

8780.08 

4840.29 

782.62 

0.02 

0.04 0.02 

4 

10,185.80 

4700.21 

851.32 

0.03 

0.05 0.03 

SOLUTION 





3D Coordinate Transformation of File: 
using generalized least squares method 




Measured Points 





NAME 

X 

y 

Z 

Vx 

Vy Vz 

1 

1094.883 

820.085 

109.821 

-0.001 

-0.001 -0.000 

2 

503.891 

1598.698 

117.685 

-0.002 

0.000 0.000 

3 

2349.343 

207.658 

151.387 

-0.001 

0.000 0.000 

4 

1395.320 

1348.853 

215.261 

0.001 

0.000 -0.001 

CONTROL POINTS 





NAME 

X 

VX 

Y VY 


z vz 

1 

10037.810 

-0.063 

5262.090 -0.026 


772.040 -0.001 

2 

10956.680 

-0.019 

5128.170 0.063 


783.000 -0.027 

3 

8780.080 

0.000 

4840.290 0.038 


782.620 -0.001 

4 

10185.800 

0.032 

4700.210 -0.085 


851.320 0.007 

Transformation Coefficients 





Scale = 0.94996 +/- 0.00002 

Omega = 2° 17' 00.0" +/- 0” 00' 26.7" 

Phi = -0° 33' 05.6" +/- 0” 00' 06.1" 

Kappa = 224° 32' 11.5" +/- 0° 00' 07.7" 

Tx = 10233.855 +/- 0.066 

Ty = 6549.964 +/- 0.055 

Tz = 720.867 +/- 0.219 
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Reference Standard Deviation: 1.293 
Degrees of Freedom: 5 
Iterations: 3 

Transformed Coordinates 


NAME 

X 

Sx 

Y 

sy 

Z 

Sz 

1 

10037.874 

0.082 

5262.116 

0.063 

772.041 

0.275 

2 

10956.701 

0.087 

5128.106 

0.070 

783.027 

0.286 

3 

8780.080 

0.098 

4840.251 

0.087 

782.622 

0.314 

4 

10185.767 

0.096 

4700.296 

0.072 

851.313 

0.324 

5 

10722.016 

0.075 

5691.210 

0.062 

766.067 

0.246 

6 

10043.245 

0.074 

5675.887 

0.060 

816.857 

0.246 


PROBLEMS 

Note: For problems requiring least squares adjustment, if a computer program 
is not distinctly specified for use in the problem, it is expected that the least 
squares algorithm will be solved using the program MATRIX, which can be 
found on the book’s companion website. Partial answers to problems marked 
with an asterisk can be found in Appendix H. 


*22.1 Solve Problem 11.11 using the general least squares method. Assign all 
coordinates a standard deviation of 1. 

22.2 Do Problem 11.16 using the general least squares method. Assign the 
computed coordinates the following standard deviations. 


Station 

S x 


Station 

S x 

Sy 

A 

0.001 

0.001 

B 

0.020 

0.012 

C 

0.020 

0.013 

D 

0.020 

0.021 

E 

0.020 

0.027 

F 

0.020 

0.028 

G 

0.020 

0.035 

H 

0.020 

0.040 

I 

0.020 

0.046 





22.3 Solve Problem 11.18 using the general least squares method. Assign all 
coordinates a standard deviation of 0.1. 

*22.4 Do Example 18.1 using the general least squares method. Use the fol¬ 
lowing standard deviations for the control coordinates. 
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Point 

s x 


A 

0.0010 

0.0010 

B 

0.0011 

0.0011 

C 

0.0010 

0.0012 

D 

0.0010 

0.0011 

E 

0.0010 

0.0010 


22.5 Do Problem 18.2 using the general least squares method. Use the fol¬ 
lowing standard deviations for the control coordinates. 


Point 

S x 


A 

0.0097 

0.0094 

B 

0.0101 

0.0080 

C 

0.0113 

0.0096 

D 

0.0081 

0.0096 


*22.6 Solve Problem 18.3 using the general least squares method and the 
additional data in Problem 22.4. 

22.7 Solve Problem 18.4 using the general least squares method and the 
additional data in Problem 22.5. 

*22.8 Solve Problem 18.12 using the general least squares method and the 
following standard deviations for the control. 


Point 

Se 

s N 

1 

0.010 

0.010 

2 

0.008 

0.011 

3 

0.009 

0.010 

4 

0.010 

0.011 

5 

0.010 

0.009 

6 

0.009 

0.009 


22.9 Solve Problem 18.13 using the general least squares method and the 
following standard deviations for the control. 


Point 

Se 

S N 

1 

0.0055 

0.0047 

2 

0.0047 

0.0050 

3 

0.0058 

0.0053 

4 

0.0058 

0.0050 

5 

0.0054 

0.0052 
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22.10 Solve Problem 18.14 using the general least squares method and the 
following standard deviations for the control. 


Point 

s x 

Sr 

1 

0.010 

0.009 

2 

0.010 

0.008 

3 

0.011 

0.010 

4 

0.008 

0.010 

5 

0.011 

0.011 

6 

0.011 

0.009 

7 

0.009 

0.010 


22.11 Solve Problem 18.17 using the general least squares method and the 
following standard deviations for the control. 

Point 

&E 

S N 

Sh 

1 

0.005 

0.004 

0.006 

2 

0.005 

0.005 

— 

3 

0.005 

0.005 

0.005 

4 

0.005 

0.005 

0.005 

5 

- 

- 

0.007 

22.12 Solve Problem 18.18 using the general least squares method and the 

following standard deviations for the control. 

Point 


s N 

S h 

1 

0.010 

0.009 

0.012 

2 

— 

— 

0.011 

3 

0.010 

0.010 

— 

4 

0.010 

0.010 

0.009 

5 

— 

— 

0.008 

6 

0.011 

0.010 

- 


22.13 Use the general least squares method to transform the points from the 
measured system to the control system using a two-dimensional: 

(a) conformal transformation. 

(b) affine transformation. 

(c) projective transformation. 
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Point 

Measured Coordinates 



Control Coordinates 


X 

(mm) 

y 

(mm) 

s x 

(mm) 

5, 

(mm) 

X 

(mm) 

Y 

(mm) 

s* 

(mm) 

S F 

(mm) 

6 

103.555 

-103.670 

0.003 

0.004 

103.951 

-103.969 

0.009 

0.009 

7 

0.390 

-112.660 

0.005 

0.005 

0.001 

-112.999 

0.009 

0.009 

3 

0.275 

111.780 

0.004 

0.007 

0.001 

112.993 

0.009 

0.009 

4 

103.450 

102.815 

0.003 

0.004 

103.956 

103.960 

0.009 

0.009 

5 

112.490 

-0.395 

0.003 

0.003 

112.998 

0.003 

0.009 

0.009 

32 

18.565 

-87.580 







22 

-5.790 

2.035 







12 

6.840 

95.540 







13 

86.840 

102.195 







23 

93.770 

2.360 







33 

92.655 

-90.765 







22.14 

Given the following data, transform the points from the measured 


system to the control system using 

a three-dimensional conformal 


coordinate transformation. Assume that all coordinates have estimated 


standard deviations of ±0.05 m. Use the general least squares method. 


Point 

Measured Coordinates 

Control Coordinates 

x (m) 

j(m) 

z( m) 

X (m) 

Y (m) 

Z(m) 

1 

607.54 

501.63 

469.09 

390.13 

499.74 

469.32 

2 

589.98 

632.36 

82.81 

371.46 

630.95 

81.14 

3 

643.65 

421.28 

83.50 

425.43 

419.18 

82.38 

4 

628.58 

440.51 

82.27 




5 

666.27 

298.16 

98.29 




6 

632.59 

710.62 

103.01 





Solve each problem with the ADJUST program using the standard and 
general least squares adjustment options. Compare and explain any 
noted differences in the solutions. 

22.15 Problem 22.1. 

22.16 Problem 22.2. 

22.17 Problem 22.3. 

22.18 Problem 22.4. 
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22.19 

Problem 22.5. 

22.20 

Problem 22.6. 

22.21 

Problem 22.7. 

22.22 

Problem 22.8. 

22.23 

Problem 22.9. 

22.24 

Problem 22.10. 

22.25 

Problem 22.11. 

22.26 

Problem 22.12. 

22.27 

Problem 22.13. 

22.28 

Problem 22.14. 


PROGRAMMING PROBLEMS 

Develop a computational program that constructs the B , Q, J, and K matrices 
for each of the following transformation. 

22.29 A two-dimensional conformal coordinate transformation. 

22.30 A two-dimensional affine coordinate transformation. 

22.31 A two-dimensional projective coordinate transformation. 

22.32 A three-dimensional conformal coordinate transformation. 


CHAPTER 23 


THREE-DIMENSIONAL GEODETIC 
NETWORK ADJUSTMENT 


23.1 INTRODUCTION 

With the advent of total station instruments, survey data are being 
collected in three dimensions. Thus, it is advantageous to develop an 
adjustment model that works in three dimensions. Rigorous triangulation 
adjustment models date back to Bruns (1878). The main observational data 
consists of horizontal angles, vertical angles, azimuths, and slant distances. 
It is also possible to include differential leveling in the model. Since all data are 
collected on the Earth’s surface, the local geodetic coordinate system provides 
a natural system in which to perform the adjustment. 

As shown in Figure 23.1, the local geodetic system is oriented such that 
the n axis points along the meridian of the ellipse (local geodetic north), the 
u axis is aligned along the normal of the ellipsoid, and the e axis creates a 
right-handed coordinate system. The local geodetic coordinate system can be 
related to the geocentric coordinate system (see Section 17.5) through a series 
of three-dimensional rotations discussed in Section 18.7. To align the X axis 
with the e axis, the Z axis is rotated by an amount of A - 180°. Then the Z axis 
is aligned with the u axis by a rotation of 0 - 90° about the once rotated X axis. 
The resultant expression is 


An 


"ax’ 

-Ac 
A u 

= R 2 (4> - 90°)R 3 (/l - 180°) 

AT 

AZ 


Adjustment Computations: Spatial Data Analysis, Sixth Edition. Charles D. Ghilani. 
© 2018 by John Wiley & Sons, Inc. Published 2018 by John Wiley & Sons, Inc. 
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FIGURE 23.1 Relationship between the geocentric and local geodetic coordinate 
systems. 

In Equation (23.1), changes in the local geodetic coordinate systems and 
geocentric coordinate system are represented by (An, Ae, An) and ( AX ,, AF, 
AZ), respectively. Changing the algebraic sign of e and combining the rotation 
matrices given in Section 18.7 yields 


An 


- sin cp cos A 

— sin tp sin A 

COS (p 

’az" 

Ae 

= 

— sin A 

cos A 

0 

AF 

Au 


cos cp cos A 

cos cp sin A 

sin cp 

AZ 


The changes in the coordinates of the local geodetic system can be deter¬ 
mined from the observation of azimuth Az, slant distance s, and altitude 
angle v. As shown in Figure 23.2, the changes in the local geodetic coordinate 
system can be computed as 

An = s cos v cos Az 

Ae = s cos v sin Az 

Am = ,s sin v (23.3) 



FIGURE 23.2 Reduction of observations in a local geodetic coordinate system. 
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Also, from Figure 23.2, the following inverse relationships can be developed. 

5= VA n 2 + Ae 2 + Am 2 


Az = tan -1 ( — ) 
\ An ) 


v = sin 


“(f) 


(23.4) 


By combining Equations (23.2) and (23.4), the reduced observations can 
be computed using changes in the geocentric coordinates. The resultant 
equations are 


IJ = VAX 2 + A Y 2 + AZ 2 


Az^ = tan 1 


-AX sin A,+ A Y cos A, 


Vjj = sin 


AX sin 0, cos A, - A Y sin 0, sin A, + AZ cos (p t 
_j / AX cos (pj cos A,- + A Y cos sin A, + AZ sin cp t 


// 


(23.5) 

(23.6) 

(23.7) 


In Equations (23.5) to (23.7), and A, are the latitude and longitude of the 
observing station P h AX is Xj - X h A Y is Yj - Y u and AZ is Z ; - Z t . For 
completeness, the equation for the zenith angle is 


Zy = COS 


AX cos (pj cos A,- + A Y cos </>, sin A,- + AZ sin 0, 

77 


(23.8) 


Furthermore, since an angle is the difference between two azimuths. 
Equation (23.6) can be applied to horizontal angles. 


23.2 LINEARIZATION OF EQUATIONS 

Equations (23.5) through (23.8) can be linearized with respect to the local 
geodetic coordinates. The development of these equations is covered Vincenty 
(1989) and Leick (2004). The final prototype equations for slant distances, 
azimuths, horizontal angles, and altitude angles are listed in the following 
subsections. It is important to note that the residuals implicitly exist in each 
equation in order to make the equations consistent when using observations 
containing random errors. 

23.2.1 Slant Distance Observations 

In the three-dimensional model, slant distance (also known as slope distance) 
does not need to be reduced to either the station ground marks or ellipsoid 
in the functional model. However, if they are not reduced, then the computed 
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values from Equations (23.5) to (23.8) are based on the instrument and reflector 
locations and not the station’s ground marks. 1 The prototype equation for the 
observed slant distances is 


a^drii + a 2 dej + a 2 dUj + a 4 dtij + a 5 dej + a 6 du. = Sy — IJ 0 (23.9) 

In Equation (23.9), the coefficients a l to a 6 are defined in Table 23.1, IJ 0 is 
the slant distance computed using Equation (23.5), and Sy is the observed slant 
distance. 


TABLE 23.1 Coefficients for Linearized Equations in Equations (23.11) through 
(23.13) 


(a) : 

(d) a 4 : 

(g) = 

( j ) b 4 = 

(k) b 5 = 

(0 b 6 = 
(m) C\ = 

( P ) c 4 = 

(?) c 5 = 

(/ ) c 6 = 


-(cos Vy cos Azy) 0 (b ) a 2 = -(cos v tj sin dz ;> .) 0 (c) a 3 = -(sin Vy) 0 

-(cos Vy cos Azyi )o ( e ) a 5 = -(cos v jl sin dz ; .,)o (/) a 6 = -(sin v^o 


sin Az it 


(h) b-, = —I 

IJ cos v„ / \ /./ cos v„ 

11 / 0 \ 11 / 0 


cos Ac,.,. 


(0 63 = 0 


Sln ^> 

IJ COS Vy / 


■) [cos(0 ; . ■ 


</>,) + sin 4>y sin(/ly - 2 ( )/ tan dz^] 


cos AZy 
IJ cos v„ 


[cos(2 ; - Af) - sin </>,■ sin(2 y - 2 ; ) tan Azy ] 


cos Tzy cos 

---- ][sin(2, - AA + (sin0 ; cos(2, - AA - cos<i, tanrfi,) tan dz ; - 

IJ COS Vy I 1 1 ' 7 1 ” 1 

(sin Vy cos Azy/IJ) 0 (ri) c 2 = (sin v,-,-sinTz iy ///) 0 (o)c 3 = - (cos v !> ///) 0 

- cos 4>i sin 4>j cos(2y - A t ) + sin </>, cos <pj + sin v (jl - cos v jt cos Az jt 
IJ COS V,.,. 


- cos (b, sin(2, - A,) + sin v, 7 cos v, ; sin dz- 

1 J 1 y J l J 1 

IJ COS Vy 


sin Vy sin v ;i - + sin </> ; sin </> ; + cos cos 4>j cos(2 ; - /t ; ) 
IJ COS Vy 


1 The final results of the observations can be brought to the ground by simply removing the instru¬ 
ment and reflector heights after the adjustment is complete. This procedure is further discussed in 
Section 23.4. 
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To demonstrate the derivation of the coefficients, a x is derived by taking the 
partial derivative of the slant distance formula in Equation (23.6) with respect 
to n h or 

ds An , , 

— =- (o) 

o«, s 


By substituting A n from Equation (23.3), the resulting equation for a x is 

— = - cos v« cos Az u (b) 

dn t 1 J 

Following these procedures, the remaining coefficients for Equation (23.9) 
are derived. 


23.2.2 Azimuth Observations 

The prototype equation for the observed azimuths is 


b l dn i + b 2 de t + b 2 du { + b 4 dri: + b 5 dej + b 6 duj = ay - a 0 (23.10) 


In Equation (23.10), a is the observed azimuth and a 0 is its computed value 
based on Equation (23.6) and an approximate value for the station coordinates. 

As an example, the coefficient for b x is computed by taking the partial deriva¬ 
tive of the azimuth formula in Equation (23.4) with respect to n h or 

dA z y An 2 Ae Ae , 

-—-—- ( c ) 

drij An 2 + Ae 2 An 2 An 2 + Ae 2 


By substituting the appropriate formulas from Equation (23.3), the resulting 
equation for b x is 

dAz^ s cos Vy sin Az« 

& n i s 2 cos 2 cos 2 Azy + s 2 cos 2 Vy sin 2 Azy 
s cos Vy sin Azy 

s 2 cos 2 v,;(cos 2 Az„ + sin 2 Az h ) 
sin Az.. 

= -- (d) 

S COS Vy 


In a similar fashion the remaining coefficients of Equation (23.10) can be 
derived. For the remaining linearized observation equations in this section, 
the derivation of the coefficients for each equation follows procedures simi¬ 
lar to those presented in Equations (a) through (d). The derivations are left to 
the reader. 
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23.2.3 Altitude Angle Observations 

Altitude angles are observed in the vertical plane and have a value of zero at 
the horizon. As discussed in Section 23.7, all vertical angles can be subject to 
substantial systematic errors caused by deflection of the plumb line and refrac¬ 
tion. Due to these errors, vertical angles should not be used in an adjustment 
on a regular basis. If these observations must be used in an adjustment, it is 
important to either correct the observations for the systematic errors or add 
the unknown parameters to the mathematical model to correct for the system¬ 
atic errors. As discussed in Section 23.7, adding correction parameters to a 
typical survey runs the risk of overparameterization. This occurs when there 
are more unknowns at a particular station than there are observations. In this 
case, the system is unsolvable. Thus, it is assumed that the corrections will be 
made before the adjustment. The appropriate prototype equation is 


c^drij + c 2 de t + c 2 du i + c A dn. + c 5 dej + c 6 duj = Vy — v 0 (23.11) 

The coefficients for Equation (23.11) are listed in Table 23.1. Their values 
are evaluated using the approximate coordinate values, v« is the observed alti¬ 
tude angle, and v 0 is the altitude angle computed using Equation (23.5) and 
approximate station coordinates. 

23.2.4 Horizontal Angle Observations 

As stated earlier, horizontal angles are the difference in two azimuths. That 
is, 6 hi f is computed as Az# - Az ib where b is the backsight station, i is the 
instrument station, and /'is the foresight station. The prototype equation for a 
horizontal angle is 


d x dn b + d 2 de b + d 2 du b + d A dtij + d 5 de { + d b du { 

T d~]dfij -T d^dCj -f- dgdiij — 0 bi r — Qq (23.12) 

The coefficients, d l through d g in Equation (23.12) are listed in Table 23.2, 
0 bl j is the observed horizontal angle, and 6 0 is the computed value for the angle 
based on difference between the foresight and backsight azimuths computed 
using Equation (23.6). 

23.2.5 Differential Leveling Observations 

Orthometric height differences as derived from differential leveling can also 
be included in the three dimensional geodetic network adjustment model. 
However, as discussed in Section 23.7, the inclusion of this observation type 
requires a correction for geoidal height differences between the stations 
and the application of orthometric corrections. Since the adjustment model 
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TABLE 23.2 Coefficients for Linearized Equation (23.14) 


(s) d x = 


(0 d 2 = ■ 


sin A: 


ib 


IB cos Vjj 
cos Az 


IB cos v 


[cos(0 4 - 4>t) + sin 4> b sm(X h - 4,)/ tan Az ib 
- [cos(4 4 - Xj) - sin 4> i sin(4 6 - X t ) tan Az n 


(w) d 3 


COS Az ib COS 4>b r ■ 

IB cosv ft 


[sin(4 ft - Aj) + (sin cos(2 4 - X t ) - cos 0, tan cf> b ) tan Tz ;4 ] |- 


, w ( sin Azy sin Az ib 
(v) d 4 = I 


IF cos IB cos v 


(w>) d 5 = 


cos Az ih cos Az 


IB cos v ib IF cosv ; y 


(x) d 6 = 0 


O') d 7 = - 


f sin Az 


1 


if 


IF cos v 


if 


[cos(d>; - 4>i ) + sin <pj sin(4y - 4 ; )/ tan Az if ] 


(z) do 


f cos AZjf 


\ 


IF cos v 


if 


[ 005 ( 4 ^ - Aj) - sin 4>j sin(4 4 - 4,) tan AzJ 


( aa ) d 9 = 


cos Az ib cos 4> f 

—--—- [sin(/ly - Aj) + (sin 4> j cos(4y - A t ) - cos tan 4>j) tan Az^J 


is nonlinear, the observation equation for elevation differences as given 
in Equation (11.1) must also be linearized. The prototype equation for 
differential leveling between stations / and J is 

1 duj - 1 duj « AHjj + ANy - Ahy (23.13) 

In Equation (23.13), A Hy is the observed elevation difference between 
the stations, ANy is the difference in geoidal height between the stations, 
and Ahy is the change in geodetic height. The approximately equal sign « 
is used in Equation (23.13) since the geodetic height is a geometric distance 
from the ellipsoid to the point, whereas the orthometric height is the distance 
to the point from the geoid along a curved plumb line. The difference between 
the linear distance and that of the curve is small and can be absorbed easily by 
the residuals. Thus, Equation (23.13) is shown with an equality sign typically. 

23.2.6 Horizontal Distance Observations 

As shown in Figure 23.3, the elevation differences of the endpoint stations and 
converging radii cause the horizontal distances observed from opposite ends of 
the lines to start and terminate at different points. Thus, technically, /, and l 2 are 
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FIGURE 23.3 Comparison of horizontal distances from opposite ends of the line. 


not of the same length. In the local geodetic system, the observation equations 
for /, and l 2 are 

l x = yj kn 2 x + Ae 2 

l 2 = yj A «2 + Agj (23.14) 

However, for the short distances observed in surveying practice typically, l x 
and l 2 , A«j and A n 2 , and /\e x and Ae 2 are approximately equal. Letting / equal 
l x and l 2 , A n equal Ah, and -A n 2 , and Ac equal Acj and -Ae 2 , the linearized 
observation equation in local geodetic system is 


4>j ~ 4>, 


IJ 


Mj I drij + 


A, - A.- 

-jT n j ) de i 


4>i - 4> 


jj M , ) drij 


Ai-Aj 


IJ 


N j ) dej = ly - l 0 


(23.15) 


In Equation (23.15), M, is the radius in the meridian at the observing station 
/, Nj the radius in the normal at the observing station, / (; the observed horizon¬ 
tal distance, and I 0 the computed distance using approximate coordinates and 
Equation (23.14). The radii are computed as 


M: = 


a{\ — e 2 ) 


N,= 


(1 — e 2 sin 0,) 3 / 2 
a 

yj 1 - e 2 sin 2 0 ; 


(23.16) 


23.3 MINIMUM NUMBER OF CONSTRAINTS 

A three-dimensional geodetic network adjustment requires both hori¬ 
zontal and vertical control. As discussed in Section 16.5, to fix the horizontal 
part of the adjustment requires one station fixed in position and one line of 
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known direction. This can be accomplished by fixing the latitude and longitude 
of one station, along with the azimuth of a line or the longitude of a second sta¬ 
tion. The vertical plane in the adjustment can be fixed with three bench mark 
stations. Since the adjustment is performed with geodetic heights, the orthome¬ 
tric height of the bench mark stations must be corrected using Equation (23.37). 

As discussed in Chapter 20, control can be adjusted or fixed simply by setting 
the appropriate values in the stochastic model. In the case of vertical control, 
bench marks are often given as orthometric heights. Since the geoid model is 
only known to a few centimeters, the standard deviations of geodetic heights 
for bench mark stations should not be set any better than about a centimeter. 


23.4 EXAMPLE ADJUSTMENT 

To illustrate a three-dimensional least squares adjustment, the simple network 
shown in Figure 23.4 will be used. The standard deviations for the coordi¬ 
nates are shown in Table 23.3 in the local geodetic system. This system was 
chosen since it is intuitive for assignment of realistic uncertainty values in the 
adjustment and since the adjustment will be performed in the local geodetic 
system. As shown in Table 23.3, the network is fixed in horizontal position 
by overweighting of the northing and easting coordinates of station A and 
rotationally by overweighting the azimuth of line A B. The horizontal rota¬ 
tion of the network could have also been fixed by overweighting of the easting 
of station B. 

The elevation datum was fixed in position and rotation by overweighting 
the height components of stations A, B , and C. Since orthometric heights 
were given for the stations, the geoid separation was applied following 
Equation 23.37 to compute geodetic heights for the stations. All the distance 
observations were observed in metric units. The systematic errors discussed in 
Section 23.7 were removed from all angular observations. The results of the 
adjustment are shown in Figure 23.4. 

While the adjustment is performed in the local geodetic system, both geode¬ 
tic and geocentric coordinates are required to compute the coefficients and 



c 


FIGURE 23.4 Example three-dimensional geodetic network. 
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TABLE 23.3 Data for Figure 23.4 


Geodetic Positions 

Point 

Latitude (4>) 


Longitude (X) 

Fleight (m) 

A(m) 

A 

41° 18'26.04850" 

N 

76°00'10.24860" W 

372.221 

-31.723 

B 

41°18'40.46660"N 

76°00'05.50180"W 

351.394 

-31.713 

C 

41° 18'22.04010" 

N 

76°00'00.94390" W 

362.865 

-31.726 

D 

41° 18'27.65860" 

N 

76°00'31.38550" W 

370.874 

-31.722 

Geodetic Azimuth 

«AB 

13°56'26.9" ± 0.001 

ft 



Slant Distances 

Course 

Distance 


S (m) 



AB 

458.796 


0.005 



AC 

249.462 


0.005 



CD 

729.122 


0.006 



DA 

494.214 


0.005 



BC 

578.393 


0.005 



Florizontal Angles 

Stations 

Angles 


S(") 



DAB 

98°10'25" 


2.8 



BAC 

105°47'45" 


3.5 



CAD 

156°01'44" 


4.1 



ABC 

335°29'37" 


2.4 



CBA 

24° 30'19" 


2.4 



BCD 

294° 19' 17" 


2.3 



DC A 

15°59'01" 


3.3 



ACB 

49°41'45" 


3.4 



CDA 

352°00'45" 


2.2 



ADC 

7° 59'12" 


2.2 




Zenith Angles 

Stations 

Angle 

SC') 

AC 

92°09'01" 

2.5 

CD 

89°22'24" 

0.8 

DA 

89°50'44" 

1.2 

AB 

92° 36'12" 

1.4 

BC 

88°52'01" 

1.1 

















TABLE 23.3 ( continued ) 
Elevation Differences 
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Stations 

AElev (m) 

S (m) 


AC 

-9.359 

0.005 


Uncertainties of Positions in 

Local Geodetic System 


Station 

S n (m) 

S e (m) 

S h (m) 

A 

O.OOi 

0.001 

0.01 

B 

- 

- 

0.01 

C 

- 

- 

0.01 

D 

- 

- 

- 


computed observations. Since traditional observations are taken by an elevated 
instrument to some elevated target, the geodetic heights of each station must be 
increased by the setup heights when computing geodetic coordinates. This sim¬ 
ple addition to the software removes the need for reducing observations to the 
station marks. In this example, the setup heights of the instruments and targets 
are assumed to be zero and thus do not need to be considered. 


23.4.1 Addition of Slant Distances 

Following prototype Equation (23.9), each slant distance observation adds one 
row to the system of equations. As an example for the slant distance AC, the 
coefficients are computed as 

- (cos v AB cos Az ab ) 0 dn A — (cos v AB sin A: ab ) 0 de A - (sin v AB ) 0 du A 

- (cos v BA cos A~ ba ) 0 dn B - (cos v BA sin Az ba ) 0 de B - (sin v BA ) 0 du B = s AB - AB 0 (23.17) 

In Equation (23.17), the values for Az ab and Az ba are computed using 
Equation (23.6), v AB and v BA are computed using Equation (23.7), and AB 
using Equation (23.5). The numerical values, to five decimal places, for 
Equation (23.17) are 

- 0.96954 dn A - 0.24067 de A + 0.04541 du A — 0.96954 dn R 

(23.18) 

+ 0.24069 de B - 0.04534 du B = 0.0017 


For each slant distance, a similar observation equation is written. The 
reader should note in Equation (23.18) that unlike plane adjustments as 
presented in Chapter 13, the coefficients of the occupied and sighted stations 
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vary slightly due to Earth curvature. Four more equations for distances AC, 
CD, DA, and BC are added to the system of equations. 


23.4.2 Addition of Horizontal Angles 

The observed angles in the network were corrected for the systematic errors 
caused by the height of targets and deflection of the vertical as given in 
Equations (23.30) through (23.32). Following prototype Equation (23.12), an 
observation equation is written for each horizontal angle. As an example, the 
observation equation for angle DAB is 


AD cos v AD 




-{ 


cos Az ad , , 3 

g „ [cos(A fl - A a ) + sin <p A sin (A D - A a ) tan Az ad \ a 

4 iU COS v AD Jo 


{ AD cos V AD 
sin A: ad cos cj) D 


AD cos v AD 
sin Az ab 


Az ad 


sin(2£, ■ 
sin a =ad 


' 4 a ) + 


I tail r ucjr) 

) 0 

' sin 4>a coslA^, — A a ) \ + A ]\ , 

v — cos 4> a tan <p D )^An\]du D 


ADcosv ad ) 0 
cos A: ab 


dn A 


+ / cos Az ad _ cos Az ab \ 

\ AD cos v AD ABcosv ab J 0 

f sin Az ab [ sin <p B sin(l B — A A )) ) 

- ) T5 - cos (cp B - (j) A ) +----- > dn B 

\AB cos v AB tan Az ab J 0 


v.-- Ati J U 

f cos A: ab r . 1 

" ) An™* „ i cos( ^ - a a) + sm 4>a - A a ) tan Az ab \ f de B 

I ABCOSV ab ) 0 

f ™ *=*,«**, [sin(4 -1 a)+ ( ^ ) tavAz J 1 

\ AB cos v ab b a \ - cos cp A tan (j> B ) ]J C 

= 9DAB ~ °0 


(23.19) 


In Equation (23.19) the values in the {} are evaluated at their approximate 
coordinate values, d DAB is the observed angular value corrected for the sys¬ 
tematic errors discussed in Section 23.7, and 6 0 is the value computed based 
on the difference in the computed values for the backsight (AD) and foresight 
(AB) azimuths. Substituting the appropriate values into Equation (23.19) and 
converting the radian values to units of s/m results in 

- 415.247 dn D - 41.991 de D — 0.0000ldu D + 523.669 dn A 

- 394.828rfe^ + 0 du A - 108 ,dn B + 436.790rfe B - 0.00003 du B = 11.582" 

(23.20) 

For each angle, a similar observation equation is written, resulting in 10 
equations in total to be added to the adjustment. 
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23.4.3 Addition of Zenith Angles 

All the zenith angles in this example problem were corrected for deflection of 
the vertical, refraction and target height as discussed in Section 23.7. Following 
Equation (23.11), the observation equation for the zenith angle from A to C is 


sinv^cosT-:^ \ / sin v AC sin A: AC 

dn A + 


AC 


AC 




- cos <t> A sin 4> c cos(4 c - A a ) + sin <p A cos <p c + sin v AC cos v CA cos Az ca 

AC cos v AC 

- cos 4> a sin(3 c - A A ) + sin v AC cos v CA sin Az ca ' 

+ I ---—- 1 de r 


du r 


dn r 


AC cos v AC /0 

sin v AC sin v CA + sin (p A sin <p c + cos <f> A cos <p c cos(/l c - A a ) 


AC COST 


AC 


— V at Vn 


(23.21) 


In Equation (23.21), the coefficients on the left side of the equations are 
evaluated using the approximate values of the coordinates in Equations (23.5) 
through (23.7). The numerical values for Equation (23.21) in units of s/m are 


\S395dn A — 26.947 de A — 826.229 du A — \5319dn c + 26.919<fe c + 826.230 du c 
= 2.971" 


For each zenith angle, a similar observation equation is written, resulting 
in five equations in total to be added to the adjustment. These observations 
are only added to demonstrate their inclusion in an adjustment. Readers are 
reminded that the inclusion of vertical angles into an adjustment is not rec¬ 
ommended due to the difficulties in removing the systematic error caused by 
refraction. 


23.4.4 Addition of Observed Azimuths 

As discussed in Section 23.7, observed azimuths must be corrected for deflec¬ 
tion of the vertical and height of the target. In this example, the azimuth was 
already given as its geodetic value. Thus, the azimuth was used to fix the adjust¬ 
ment by overweighting. The observation equation for the geodetic azimuth is 


(4^-) dn A 
\AB cos v AB J 0 

_ f / sin Az ab 

\\AB cos v AB 

+ f / cos Az ab 

\ \ AB cos v AB 


( cos Az ab 
\AB cos v AB 


) de A + 0 du A 
o 


^ [cos(</> 5 - 4> a ) + sin(p B sin(2 B - 
) [cos(2 s - A a ) - sin cj> A sin(/l B - 


A A ) cot Az as] 

A a ) tan Az ab ] 


dn B 

o 

de B 

o 
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COS Az ab COS <p B 
AB COS V AB 


sin (X B - A a ) 


/sin 4> a cos(^-^)\ 
\ - cos 4> a tan 4> r ) 


tan Az ab 


> du B 

J o 


— a AB — a 0 


(23.22) 


In Equation (23.22), the coefficients on the left side are evaluated using the 
approximate coordinate values using Equation (23.5) through Equation (23.7). 
The numerical values of Equation (23.22), in units of s/m, are 


108. 42dn A — 436.19de A + 0du A — l0$A3dn B + 436.19de B - 0.00003 du B 
= -0.256" 


23.4.5 Addition of Elevation Differences 

Leveling is a process of determining heights above the geoid. The data for this 
example lists the orthometric and geoidal heights for each station. The dif¬ 
ference in orthometric heights requires the application of Equation (23.38) to 
obtain the geodetic height differences between the stations. The observation 
equation for the elevation difference between stations A and C is 

1 du c - 1 du A = A H ac + A N ac - A h AC (23.23) 

The resulting numerical values for Equation (23.23) are 

1 du c - \du A = -9.359 + (-31.726 + 31.723) 

-(331.139 - 340.498) 

= -0.003 m 


23.4.6 Adjustment of Control Stations 

With the addition of the u coordinate, observation equations similar to those 
presented in Section 19.2 can be added for each control coordinate. As stated 
in Section 23.1, the local geodetic coordinate system has its origin at each 
instrument station. Thus, it is not a true coordinate system with a single origin. 
Because of this, the approximate coordinates for each station must be stored 
in either the geocentric or geodetic coordinate system. In this discussion, it is 
assumed that the values are stored in the geodetic coordinate system. Again, 
nonlinear versions of the equations must be written to match the overall non¬ 
linear nature of the adjustment. The observation equations are 


1 dn = N - n 

(23.24) 

1 de = E - e 

(23.25) 

\du = U — u 

(23.26) 


where (N, E, U) are the given control coordinate values and (n, e, u) are their 
adjusted values. In the first iteration, the control coordinate values and 
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their adjusted values will be the same. In subsequent iterations, small 
variations between the control coordinate values and their adjusted counter¬ 
parts will be observed. The observation equations for Station A in the first 
iteration are 

1 dn = 0 
1 de - 0 
1 du — 0 


Since the control coordinate values and approximate station coordinate 
values will be expressed in terms of geodetic coordinates. The initial if-matrix 
values given in Equations (23.24) to (23.26) will be expressed as changes 
in geodetic coordinates. These values must then be transformed into the 
local geodetic coordinate system. The relationships between changes in 
the local geodetic coordinate system and the geodetic coordinate system are 


dn 


M + h 

0 

0 

d(p 

de 

= 

0 

(N + h) cos cp 

0 

dA 

du 


0 

0 

1 

dh 


- Rlg 


d(f> 

dA 

dh 


(23.27) 


In Equation (23.27), M represents the radius in the meridian and N the 
radius in the normal at a station with latitude 4> as given by Equation (23.16), 
h the geodetic height, and R LG is the transformation matrix. The A'-matrix val¬ 
ues expressed in terms of geodetic coordinate system can be transformed into 
Ai-matrix values of the local geodetic coordinate system using Equation (23.27). 


23.4.7 Results of Adjustment 

A partial listing of the results of the adjustment from the ADJUST software 
package are shown in Figure 23.5. The solution converged in two iterations. 
Note that the latitude and longitude of station A were held fixed as was the 
azimuth of line AB. 


23.4.8 Updating Geodetic Coordinates 


At the completion of each iteration, the corrections of dn, de, and du will 
be determined for each station in the adjustment. However, geodetic coor¬ 
dinates are used to represent station positions. Thus, after each iteration 
the local geodetic coordinate system corrections of dn, de, and du must be 
transformed into changes in the geodetic system using the inverse relationship 
of Equation (23.27), or 


Hi = 


dn, 


M.+hd 


dA, = 


de, 


(N, + hj) cos (</>,■) ’ 


dh, = du, 


(23.28) 
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Adjusted Geodetic Coordinates 


Station 

Latitude 

Longitude 

Orth height 

N 

S-LatO s-Lon(") 

S-h 

======= 

================== 

================= 

============= 

========== 

==================== 

======== 

A 

41°18'26.04850*N 

76°00'10.24860"W 

372.2232 

-31.72 

0.000065 0.000087 

0.0119 

B 

41“18'40.46653*N 

76°00'05.50185"W 

351.3904 

-31.71 

0.000231 0.000113 

0.0120 

C 

41°18'22.04015Ti 

76°00'00.94395*W 

362.8664 

-31.73 

0.000162 0.000270 

0.0119 

D 

41°18'27.65788*N 

76*00*31.38547*W 

370.8748 

-31.72 

0.000304 0.000353 

0.0124 

Station 

Statistics 






Station 

Sn 

Se 

t-ang* 

Su 

Sv 

S-Elev# 

A 

0.0020 

0.0020 

45.0000 

0.0020 

0.0020 

0.0119 

B 

0.0071 

0.0026 

13.9417 

0.0073 

0.0020 

0.0120 

C 

0.0050 

0.0063 

96.0029 

0.0063 

0.0050 

0.0119 

D 

0.0094 

0.0082 

175.3588 

0.0094 

0.0082 

0.0124 


♦-Values do not include uncertainty in geoidal height. 


Adjusted Slope Distances 


Station 

Occupied 

Station 

Sighted 

Distance 

V 

A 

B 

458.792 

-0.004 

A 

C 

249.468 

0.006 

C 

D 

729.116 

-0.006 

D 

A 

494.213 

-0.001 

B 

C 

578.399 

0.006 

Adjusted Mark-to-Mark 

and Geodetic Distances 



Station 

Station 

Mark-to-Mark 

Geodetic 

Occupied 

Sighted 

Distance 

Distance 


A 


B 


458.792 


458.317 

A 


C 


249.468 


249.282 

C 


D 


729.116 


729.034 

D 


A 


494.213 


494.182 

B 


C 


578.399 


578.255 

Adjusted Angle 

Observations 






Station 

Station 


Station 




Backsighted 

Occupied 


Foresighted 


Angle 

V(*) 


D 

A 

B 

98*10*22.13* 

-2.87 

B 

A 

C 

105*47*52.54* 

7.54 

C 

A 

D 

156*01*45.34* 

1.34 

A 

B 

C 

335*29*34.52* 

-2.48 

C 

B 

A 

24*30*25.48* 

6.48 

B 

C 

D 

294*19*09.93* 

-7.07 

D 

C 

A 

15°59'08.09* 

7.09 

A 

C 

B 

49*41*41.98* 

-3.02 

C 

D 

A 

352*00*53.43* 

8.43 

A 

D 

C 

7*59'06.57* 

-5.43 

Adjusted Azimuth 

Observations 




Station 

Station 




Occupied 

Sighted 


Azimuth 

V 


A B 13°56'26.9' 0.00* 

FIGURE 23.5 ADJUST listing of adjustment results for example problem in 
Figure 23.4. 
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Adjusted 

Station 

Occupied 

Zenith Angle Observations 

Station 

Sighted 

Zenith Angle 

vr> 

A 

B 

92°36'12.2" 

— 0.19" 

A 

C 

92°09'04 -7" 

-3.69* 

C 

D 

89°22'25.1" 

-1.05* 

D 

A 

89°50'45.6" 

-1.61* 

B 

C 

88°52'01.3* 

-0.26* 

Adjusted 

Station 

Occupied 

Elevation Difference Observations 

Station 

Sighted 

Elevation 

Diff. 

V 

A 

C 

-9.363 

-0.0038 


Iterations = 2 
Redundancies =15 
Reference Variance = 4.075 

Reference So = ±2.019 

FIGURE 23.5 ( continued ) 

In Equation (23.28), the corrections to the latitude, longitude, and geodetic 
height of station / are dcp t , dk n and dh r respectively. All other terms are as 
previously defined in this chapter. Similarly the uncertainties for each station 
will be in the local geodetic system. Although these uncertainties can be used 
to represent northing, easting, and geodetic height errors at each station. 
Equation (6.13) must be used to transform these uncertainties into the geodetic 
system as 

(23.29) 


R = 


Note that the errors in the coordinates at each station can be com¬ 
puted in using the 3x3 block-diagonal elements from the Q xx matrix of the 
adjustment. 

23.5 BUILDING AN ADJUSTMENT 

Since this is a nonlinear adjustment, initial approximations are required for 
all station parameters. Very good initial values for horizontal coordinates can 
be determined using the procedures outlined in Chapter 16, with horizontal 
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observations reduced to a map projection surface. Following the adjustment, 
grid coordinates can be converted to their geodetic equivalents. Likewise, 
orthometric heights of stations can be determined using the procedures 
discussed in Chapter 12. The resulting orthometric heights can be converted to 
geodetic heights using Equation (23.37). Since these are initial approximations, 
it is possible to use an average geoidal height N for the region when applying 
Equation (23.37). Flowever, this procedure will result in more uncertainty in 
the resulting derived heights. 

Before combining a large set of three-dimensional observations, it is wise to 
perform adjustments using the horizontal and vertical functional models pre¬ 
sented in Chapters 12 and 16 to isolate potential blunders. For large regional 
data sets, smaller subset of data should be adjusted to isolate blunders. After 
these smaller data sets are cleaned and adjusted, a combined adjustment 
can be attempted with better initial approximations for the unknowns and 
the knowledge that most, if not all, large blunders have been removed from the 
data sets. 


23.6 COMMENTS ON SYSTEMATIC ERRORS 

Usually, small local surveys result in systematic error components that are 
small enough to be considered negligible. Flowever, as the size of the survey 
increases, variations in the direction of plumb lines must be taken into 
account. This error can be removed from angular observations prior to the 
adjustment with a priori knowledge of the deflection components r] and at 
each station. In the United States, modeled values for these components can 
be obtained using software such as DEFLEC12B, 2 which is available from 
the National Geodetic Survey. The systematic error corrections to the zenith 
angles, azimuths, and horizontal angles are 

Zy = z'y + (*■ cos Azy + r], sin Azy (23.30) 

A zy = Az obs + r] t tan+ (£,sin Az obs - ^cos Az obs ) cot z tj (23.31) 

/.BIF = zBIF obs + (£,■ sin Az ib - /■/, cos AzA cot z if 

- (£,. sin Az ib - r/j cos Az ib ) cot z ib (23.32) 

where »/,■ and £, are the deflection of the vertical components at the observa¬ 
tion station /; zA is the observed zenith angle from station / to /, and z b the 
corrected zenith angle between the same stations; Az ohs is the observed astro¬ 
nomical azimuth between station / and /, and Az b is the corrected azimuth 
between the same stations; Z.BIF obs is the observed angle where station B is the 


2 DEFLEC12B is available at http://www.ngs.noaa.gov/GEOID/. 
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back sight station, I the instrument station, and F the foresight station, and 
aBIF is the corrected horizontal angle between the same stations. 

Additionally, target height differences must also be considered for both 
directions and angles. The azimuth of a line corrected for target height is 

Az c - a + O.lOS^cos 2 ^, sin 2a (23.33) 

In Equation (23.33), Az c is the corrected azimuth, a the observed azimuth, 
4>j the latitude of the observation station, and h the geodetic height of the tar¬ 
get. Since an angle is simply the difference between the foresight and backsight 
azimuths, the correction to an angle due to height of the targets is 


9 C = 6 bi j + 0.108"cos 2 d>, 


s\n(2a Ahj 
1000 


sin(2 a ib )h b 
1000 


(23.34) 


where 9 C is the corrected angle, 0 hi f the observed angle, and a if and a ib the 
azimuths of the foresight and backsight lines, respectively. 

Atmospheric refraction must be considered when including vertical angles 
in an adjustment. Since the correction for atmospheric refraction is so diffi¬ 
cult to model, one can only hope to account for a portion of correction in an 
adjustment. The remainder of the correction must be modeled in the adjust¬ 
ment, or be absorbed in the residuals of the observation. The correction of the 
hi st order effect of refraction can be determined by observing simultaneously 
vertical/zenith angles at each end of the line /./. From these observations, the 
first-order corrected Z c .. using these observed reciprocal zenith angles is 

Z£ = 0.5 (Zy + Z fl ) - 90° - y/ (23.35) 

In Equation (23.35), Z tj and Z v are the observed simultaneously reciprocal 
zenith angles and y/ the correction for the deflection of vertical computed as 


yr = -(£,• cos Azy + ?/,- sin AzA (23.36) 

It is possible to create an adjustment model that includes correction terms 
for rj, I, and atmospheric refraction. However, due to the limited number of 
observations in a typical survey network, there is a danger of overparameteri¬ 
zation (Leick, 2004). Thus, it is recommended that these corrections be applied 
to the angles before carrying out the adjustment. 

Unfortunately, to determine the deflection of the vertical components (y and 
<*), the latitude and longitude of the station must be known before the com¬ 
pletion of the adjustment. Approximate values for latitude and longitude will 
suffice in most instances. However, in instances where good approximations 
for the geodetic coordinates are not known, it is possible to correct the original 
observations after an initial adjustment to ensure that the geodetic coordinates 
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for each station are close to their final values. In this case, after correcting the 
observations, the adjustment can be run a second time. 

A similar problem exists with differential leveling observations. Geodetic 
height li and orthometric height H differ by the geoidal height N, or 

htxH + N (23.37) 


where h is the geometric distance between the ellipsoid and the point, H the 
distance along the plumb line from the geoid to the point, and N the separa¬ 
tion between the ellipsoid and geoid. Equation (23.37) is approximate since the 
geoid separation differs at the line defined by h and H and since the plumb line 
is a curved line between the point and the geoid. These differences are small and 
thus, the approximately equal symbol is replaced with an equal sign generally 
in Equation (23.37). 

Elevation differences as determined by differential leveling must account for 
the differences in geoidal height between the bench mark stations. This situa¬ 
tion can be mathematically described as 


hj - h t = (Hj - Nj) - (Hj - Nj) 

Ah = AH + AN 


(23.38) 


The correction to leveled height differences should be performed when these 
observations are included in the three-dimensional geodetic network adjust¬ 
ment. Values for geoidal height can be determined using software similar to 
GEOID12B, which is available from the National Geodetic Survey. 3 Similar to 
the deflection of the vertical parameters, it is possible to include geoidal height 
parameters in the mathematical model of the adjustment. Again, this approach 
runs a risk of overparameterization in the adjustment. 

The orthometric correction O c for a leveling line can be approximated using 
a formula derived by Bomford (1980) as 


O c = 


—7/(A0")(O.OO53 sin 2<f>) 
P 


(23.39) 


where H is the orthometric height at the instrument station, Acp" is the 
change in latitude between the backsight and foresight stations in units of 
arc-seconds, cp the latitude of the instrument station, and p the conversion 
from seconds to radians, which is approximately 206,264.8"/radian. Obviously, 
Equation (23.39) would be tedious to apply for a substantial north-south 


3 GEOID12B software is available at http://www.ngs.noaa.gov/GEOID/. 
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leveling circuit. However, for most typical surveys involving small regions, 
this correction can be very small and easily absorbed in the residuals of the 
adjustment. For instance, a 120-km, north-south leveling line at approximately 
42° latitude would result in an approximate orthometric correction of 2 cm. 


23.7 SOFTWARE 

ADJUST contains an option to adjust three-dimensional geodetic networks. 
As shown in Figure 23.6, the software allows for the entry of geoidal heights, 
deflection of the vertical components, and target heights. The help hie that 
accompanies ADJUST describes the hie format when these additional features 
are needed. The data hie Example 23-4.dat for the example in Section 23.4 is 
shown in Figure 23.7 and is on the book’s companion website. This hie has 
the geoidal heights added to the hie. Notice that the observations are listed in 
the order of slant distances, horizontal angles, azimuths, altitude angles, hori¬ 
zontal distances, and differences in elevation. In this hie, only the observations 
given in Section 23.4 are listed. For those wishing to program the material in 
this chapter in a higher-level language, the Mathcad 8 worksheet X23.xmcd, 
which is also available on the companion website, demonstrates the procedures 
necessary for the adjustment. 



FIGURE 23.6 ADJUST options for a three-dimensional geodetic network 
adjustment. 
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Example 23.4 


5 

10 

1 1 

5 0 14 

//sdist, hang. 

az, vang 

, hdist. 

de, sta 

A 

41 

18 

26.04850 

-76 

00 

10.24860 

340.498 

-31.723 

0.001 0.001 0.01 

B 

41 

18 

40.46660 

-76 

00 

05.50180 

319.681 

-31.713 

0.01 

C 

41 

18 

22.04010 

-76 

00 

00.94390 

331.139 

-31.726 

0.01 

D 

41 

18 

27.65860 

-76 

00 

31.38550 

339.152 

-31.722 



A B 458.796 0.005 
A C 249.462 0.005 
B C 578.393 0.005 
C D 729.122 0.006 
D A 494.214 0.005 
D A B 98 10 25 2.8 
B A C 105 47 45 3.5 
CAD 156 01 44 4.1 
ABC 335 29 37 2.4 
C B A 24 30 19 2.4 
BCD 294 19 17 2.3 
D C A 15 59 01 3.3 
A C B 49 41 45 3.4 
C D A 352 00 45 2.2 
A D C 7 59 12 2.2 
A B 13 56 26.9 0.001 
A B 92 36 12 1.4 
A C 92 09 01 2.5 
B C 88 52 01 1.1 
C D 89 22 24 0.8 
D A 89 50 44 1.2 
A C -9.359 0.005 

FIGURE 23.7 ADJUST data file for example in Section 23.4. 

PROBLEMS 

Note: Unless otherwise specified, use the GRS 80 ellipsoidal parameters of 
a = 6.378.137.0 m and/ = 1/298.257222101 for the following problems. Partial 
answers to problems marked with an asterisk can be found in Appendix H. 

*23.1 Using the data supplied in Figure 23.4, what is the computed value 
for the slant distance ABl 

23.2 Same as Problem 23.1, except for slant distance CD. 

*23.3 Using the data supplied in Figure 23.4, what is the computed value 
for the azimuth A B'! 

23.4 Using the data supplied in Figure 23.4, what is the computed value 
for azimuth ADI 

*23.5 Using the data supplied in Figure 23.4, what is the computed value 
for the horizontal angle DAB1 

23.6 Same as Problem 23.5, except for horizontal angle DCA. 

*23.7 Using the data supplied in Figure 23.4, what is the computed altitude 
angle value for the v AB ? 
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23.8 Same as Problem 23.7, except for the zenith angle v CD . 

*23.9 Develop the observation equation for slant distance AC in Figure 23.4 
(5 decimal places). 

23.10 Same as Problem 23.9, except for slant distance DA. 

*23.11 Develop the observation equation in units of s/m for horizontal angle 
BAC. 

23.12 Same as Problem 23.11, except for horizontal angle DCA. 

23.13 Develop the observation equation for zenith angle AB. 

23.14 The approximate values for the geodetic coordinates of the endpoints 
of line AB are A: (41° 18'16.2396" N, 75°46'40.8000" W, 321.161 m) 
and B\ (41° 18T7.7759" N, 75°47'36.6767" W, 285.997 m). Using the 
WGS 84 ellipsoid, determine the computed 

(a) slant distance AB. 

(b) azimuth AB. 

(c) zenith angle AB. 

23.15 Similar to Problem 23.14, except the approximate values for the 
geodetic coordinates are A: (43° 15'01.8253" N, 89°46'57.8546" W, 
108.540 m) and B: (43°15'26.8987" N, 89°46'47.9265" W, 121.346 m). 

23.16 Develop the observation equation for slant distance AB in Problem 

23.14 if the observed distance is 1301.261 m. 

23.17 Develop the observation equation if the observed distance in Problem 

23.15 is 805.645 m. 

23.18 Develop the azimuth observation equation in units of s/m for Prob¬ 
lem 23.14 if the azimuth observation is 272°05'33". (Assume that all 
systematic errors are removed from the observation.) 

23.19 Develop the azimuth observation equation for Problem 23.15 if the 
azimuth observation is 16°08'24". (Assume that all systematic errors 
are removed from the observation.) 

Use the following data and the GRS 80 ellipsoid in Problems 23.19 to 23.27. 


Geodetic Coordinates 


Station Latitude Longitude Height (m) S n (m) S e (m) S u (m) 


A 

40°25'28.7700"N 86°54' 15.0464"W 

92.314 

0.001 0.001 0.01 

B 

40°25'46.3978"N 86°54'12.3908"W 

80.004 

0.01 

C 

40°25'43.3596"N 86°54'30.5172"W 

87.268 

0.01 

D 

40°25'33.6000"N 86°54'28.8000"W 

95.585 

- - - 
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Angle Observations 


B 

I 

F 

Angle 

sn 

h b (m) 

^ (m) 

h f (m) 

D 

A 

C 

26°18'07.6" 

4.7 

1.303 

1.295 

1.300 

C 

A 

B 

45°35'06.7" 

4.1 

1.402 

1.405 

1.398 

B 

A 

D 

288°06 , 42.4" 

5.0 

1.295 

1.301 

1.305 

A 

B 

D 

37°50'41.9" 

4.1 

1.305 

1.398 

1.299 

D 

B 

C 

33°13'03.8" 

4.3 

1.500 

1.500 

1.500 

C 

B 

A 

288°56'09.2" 

4.6 

1.206 

1.210 

1.208 

B 

C 

A 

63°20'53.4" 

4.5 

1.300 

1.300 

1.300 

A 

C 

D 

31°21'36.2" 

5.1 

1.425 

1.423 

1.420 

D 

C 

B 

265°17'26.4" 

5.9 

1.398 

1.205 

1.300 

C 

D 

B 

52°04'25.0" 

5.3 

1.500 

1.500 

1.500 

B 

D 

A 

70°15'56.7" 

5.0 

1.500 

1.500 

1.500 

A 

D 

C 

237°39'41.8" 

6.6 

1.500 

1.400 

1.500 


Slant Distance Observations 

From To 

Distance (m) 

S ( m ) 

hi (m) 

hr (m) 

A 

B 

547.433 

0.008 

1.400 

1.500 

B 

C 

437.451 

0.008 

1.497 

1.595 

C 

D 

303.879 

0.008 

1.500 

1.500 

D 

A 

356.813 

0.008 

1.302 

1.296 

A 

C 

579.263 

0.008 

1.300 

1.500 

B 

D 

552.833 

0.008 

1.500 

1.400 


Azimuth Observations 

From 

To Azimuth 

S (") hi (m) 

hr (m) 

A 

B 6°34'04.6" 

0.001 1.500 

1.500 

Elevation Differences 

From 

To 

AElev (m) 

S (m) 

A 

C 

-5.053 

0.012 

B 

D 

13.585 

0.012 
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23.20 Use a computational program to develop the coefficient matrix for the 
angle observations in the table. List all coefficients in units of s/m. 

23.21 Use a computational program to develop the coefficient matrix for the 
slant distance observations in the table. 

23.22 Use a computational program to develop the observation equation for 
the azimuth observation in the table. List the coefficients in units of 
s/m. 

23.23 Use a computational program to develop the observation equations 
for the elevation differences in the table. 

23.24 Use ADJUST to determine the most probable values for the geodetic 
coordinates in accompanying data using only the angle, azimuth, and 
slant distance observations. 

23.25 Use ADJUST to determine the most probable values for the geodetic 
coordinates in the accompanying data using all the observations. 

23.26 Do Problem 23.25 by removing azimuth AB from the adjustment and 
overweighting the easting of Station B. The standard deviations of 
Station B should be S„ = ±1000 m, S e = ±0.001 m, and S u = ±0.01 m. 

23.27 What are the adjusted orthometric heights of the stations in the 
accompanying data? 

Use the following data and the GRS 80 ellipsoid in Problems 23.28 and 23.29. 


Geodetic Coordinates 


Station 

Latitude 

Longitude 

h (m) 

s„ 


S u 

1 

41°07T8.31000"N 

76°48'40.85000"W 

167.945 

0.001 

0.001 

0.01 

2 

41°07T3.00000"N 

76°47'46.72000"W 

167.945 

— 

— 

— 

3 

41°05'56.29000"N 

76°48'09.94000"W 

164.288 

— 

— 

— 

4 

41°06'08.68000"N 

76°48'51.63000"W 

160.935 

- 

- 

- 


Slant Distances 


Occupied 

Sighted 

Distance (m) 

S( m) 

1 

2 

1,273.362 

0.0039 

2 

3 

2,427.707 

0.0057 

3 

4 

1,045.271 

0.0036 

4 

1 

2,162.741 

0.0052 

1 

3 

2,631.079 

0.0060 

2 

4 

2,496.191 

0.0058 
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Horizontal Angles 


BS 

Occ 


FS 

Angle 

S 

2 

1 


4 

89°17'35.5" 

1.4" 

4 

1 


3 

337°24'34.0" 

1.4" 

3 

2 


4 

24°27'41.5" 

1.4" 

4 

2 


1 

60°02T6.1" 

1.4" 

4 

3 


1 

52°38'24.0" 

1.5" 

1 

3 


2 

28°47'56.7" 

1.4" 

1 

4 


2 

30°40T2.7" 

1.4" 

2 

4 


3 

74°0'51.8" 

1.5" 

Geodetic Azimuths 

Occupied 


Sighted 

Azimuth 

S 

1 


4 


186°40'45.7" 

1.4" 

Elevation Differences 

From 


To 


AElev (m) 

S 

1 


2 


0.000 

0.001 

2 


3 


-3.658 

0.001 

3 


4 


-3.354 

0.001 

4 


1 


7.010 

0.001 


23.28 Develop an observation equation for 

(a) distance 1-2. 

(b) angle 2-1-4. 

(c) azimuth 1-4. 

(d) elevation difference 1-2. 

23.29 Use ADJUST to determine the most probable geodetic coordinates 
for the survey. 

* 23.30 If £ = 4.23" and r] = -1.69" are the deflection of the vertical compo¬ 
nents at Station A in Section 23.4, what is the correction to the zenith 
angle going from Station A to BP. 

23.31 If the observed zenith angle along a line with an azimuth of 
23°15 / 36.8" is 91°04'54" and the deflection of the vertical compo¬ 
nents are £ = -3.28" and rj = 0.96", what is the corrected zenith 
angle? 
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23.32 Same as Problem 23.31, except the azimuth of the line is 143°08 / 23" 
and zenith angle is 86°58'23". 

23.33 Using the data given in Problem 23.31, what is the deflection of the 
vertical correction for the azimuth A B ? 

23.34 Using the data given in Problem 23.32, what is the deflection of the 
vertical correction for the azimuth AB if the latitude of station A is 
39°06'38.1648"? 


PROGRAMMING PROBLEMS 

23.35 Develop a computational program that corrects vertical angles for 
deflection of the vertical components. 

23.36 Develop a computational program that computes the coefficients for 
the azimuths, angles, slant distances, and elevation differences. Check 
your program using data from Problem 23.28 and 23.29. 


CHAPTER 24 


COMBINING GNSS AND TERRESTRIAL 
OBSERVATIONS 


24.1 INTRODUCTION 

Ellipsoids define the mathematical shape of the Earth, or a portion 
thereof. Ellipsoids are commonly defined by the length of their semimajor 
axis, a, and the flattening factor,/ Commonly used ellipsoids are the Geodetic 
Reference System of 1980 (GRS 80) and the World Geodetic System of 1984 
(WGS 84). Table 24.1 lists the length of the semimajor axis and flattening 
factor for these ellipsoids. 

A network of points determined with respect to each other on an ellipsoid is 
a reference frame, which is also called a datum. These reference frames define 
the geodetic coordinates of the points, and thus the origin and orientation of 
the datum. Most reference frames are regional in nature since the network 
of points only covers a portion of the Earth. These are known as local ref¬ 
erence frames. For example, the North American Datum of 1983 (NAD 83) is 
a local coordinate system consisting of a network of points in Canada, the 
United States, Mexico, and some Caribbean islands. Flowever, the Interna¬ 
tional Terrestrial Reference Frame (ITRF) is an example of a global datum 
defined by a multitude of points located on all major land masses of the Earth. 
Similarly, the coordinates derived from the GNSS satellites are determined by a 
global network of tracking stations with coordinates defined in a global datum. 
Incorrectly stated, GPS is said to be using the WGS 84 datum. This statement 
should be interpreted by the reader as the datum defined by the global network 
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TABLE 24.1 Defining Ellipsoidal Parameters 


Ellipsoid 

a (m) 

1// 

GRS 80 

6,378,137.0 

298.257222101 

WGS 84 

6,378,137.0 

298.257223563 


of tracking stations that use the WGS 84 reference ellipsoid. The Department 
of Defense (DoD) has updated this network five times since its creation at the 
beginning of GPS weeks 730, 873, 1150, 1674, and 1762. 

Besides their reference ellipsoid, reference frames differ in origin (transla¬ 
tion), scale, and rotations about the three cardinal axes. Many modern local 
reference frames and global reference frames have nearly aligned coordinate 
axes and differ by only a few meters in their origins. These are known as 
Earth-Centered, Earth-Fixed ( ECEF) coordinate systems. Thus, it is possible 
to use a three-dimensional coordinate transformation to transform points 
from a local datum to a global datum and back again. When using GNSS and 
absolute positioning techniques, the satellites serve as control points and all 
points determined by this method are defined in either the ITRF or WGS 84 
datum depending on the source of ephemeris. However, this method of sur¬ 
veying is only accurate to the meter level. Thus, relative positioning techniques 
are generally used. However, if GNSS receivers are placed on control points 
defined in a local datum such as NAD 83, the resultant points are defined in a 
hybrid of the WGS 84 or ITRF and the local datum. The differences in these 
systems are generally at the centimeter-level. For lower-order surveys, these 
differences may not be of much importance. For high-order control surveys, 
they must be taken into account. 

To combine GNSS and terrestrial observations, the control from two differ¬ 
ent reference frames must be reconciled. This can be done by transforming the 
local control coordinates into the GNSS reference datum, or by transforming 
the GNSS established points into the local datum. 

As discussed in Chapter 18, a three-dimensional conformal coordinate 
transformation will take coordinates from one three-dimensional coordinate 
system into another. However, since the reference frames are nearly aligned, 
the rotational angles are generally in the millisecond range, which is very 
small. As will be shown in Section 24.2, the rotational process, as well as the 
entire transformation can be simplified since today’s coordinate systems are 
nearly aligned. 

To perform the transformation, coordinates of common points in both 
systems must be placed into their respective geocentric coordinate systems 
(see Section 17.4). Following this conversion, a least squares adjustment can 
be performed to determine the transformation parameters between the two 
systems. Once the transformation parameters are determined, the coordinates 
of any remaining points can be transformed. 
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For example, assume that an RTK-GNSS survey is being used to stake out a 
highway alignment, and that the highway alignment was designed using control 
points from State Plane Coordinate System of 1983 (SPCS 83). 1 The real-time 
GNSS datum is defined by a set of DoD tracking stations using the WGS 84 
ellipsoid, which has been made to closely approximate the International Ter¬ 
restrial Reference Frame of 2008 (ITRF 2008). The geodetic control used in 
the State Plane Coordinate System is based on a series of National Spatial 
Reference stations in the United States, Canada, and Mexico using the GRS 
80 ellipsoid. The NEH coordinates of the highway design stations must be 
transformed from the SPCS 83 coordinate system and orthometric heights to 
geodetic coordinates. The geodetic coordinates are then transformed to geo¬ 
centric coordinates of (X, Y , Z) L in the local system. These points are occupied 
using a GNSS receiver and GNSS coordinates (X, T, Z) G derived from satellite 
observations. Once three or more common points are occupied, the transfor¬ 
mation parameters can be determined using a Helmert transformation , which 
is a simplification of the three-dimensional conformal coordinate transforma¬ 
tion presented in Section 18.7. Following this, all GNSS-derived coordinates 
are transformed into the local coordinate system, and stakeout of stations can 
be performed. 


24.2 THE HELMERT TRANSFORMATION 


A local datum such as NAD 83 is an ECEF coordinate system. This means 
that the Z axis is nearly aligned with the Conventional Terrestrial Pole, X axis 
with the Greenwich Meridian, and the origin is at the mass-center of the Earth 
as derived by the datum points used in the definition. International reference 
frames such as the International Terrestrial Reference Frame use the same defi¬ 
nitions for the axes, origin, and ellipsoid, but differ slightly due to the difference 
in the datum points used in its determination. Thus, the rotational parameters 
and translations between two ECEF coordinate systems are usually very small. 
The scale factor between two reference frames using the same units of measure 
should be nearly one. 

Since the sine of a very small angle is equal to the angle in radians, the cosine 
of a very small angle is nearly one, and the product of two very small numbers 
is nearly zero, for two nearly aligned coordinate systems the three-dimensional 
conformal coordinate transformation presented in Equation (18.14) can be 
simplified as 



1 

03 

-0 2 " 


0 

A6>3 

1- 

<N 

<1 

1 

R' = 

-03 

1 

0i 

= / + 

-A6>3 

0 

A (9, 


02 

-0i 

1 


A0 2 

-A0 X 

0 


(24.1) 


1 Map projection coordinates systems are discussed in Appendix F. 
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In Equation (24.1) A 9 1 , A 0 2 , and A 0 3 are in units of radians and have been 
separated from full matrix by the addition of the unit matrix. The introduction 
of “A” indicates these values are differentially small. 

The transformation of coordinates from one local datum to another datum 
is performed as 

X LD = sR'X gd + T (24.2) 

where s is the scale factor, X GD is the (x, y, z) coordinates from the global data 
( G ) to be transferred into the local datum (L) and T the xyz translations nec¬ 
essary to make the origins of the two reference frames coincide. Similarly the 
scale factor, s, and translation parameters, T , can be modified as 


5 = 1 + A.? (24.3) 

T — T 0 + AT (24.4) 


In Equation (24.4), the approximate shift vector, T 0 , can be computed as 


X 


X 


A Tx 

y 

- 

y 

and A T = 

ATy 

z 

L 

z 

G 

ATz 


(24.5) 


Since Equation (24.2) is nonlinear, a single common point or an average of all 
the common points can be used in Equation (24.5) to obtain initial approxi¬ 
mations. For a single station, i, the linearized model for the corrections is 


X Lj - X Gj — T 0 — Jjdx 

where 


As 

A6>! 


x i 

0 

~ z i 

yt 

1 

0 

0 


AO 2 


z i 

0 

~ X i 

0 

1 

0 

; dx = 

A6>3 

z i 

~)’i 

Xi 

0 

0 

0 

1 


A 7a- 


A Ty 
ATz 


(24.6) 


(24.7) 


Example 24.1 The geocentric coordinates in the North American Datum of 
1983 (NAD 83) and, from a GNSS adjustment using a precise ephemeris, from 
the International Terrestrial Reference Frame of 2008 (ITRF 08) datum are 
shown below. Determine the transformation parameters to transform the addi¬ 
tional station into the local NAD 83 datum. 
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NAD 83 



ITRF 08 


Sta 

x (m) 

y (m) 

- (m) 

x (m) 

y ( m ) 

z(m) 

A 

1,160,604.924 

-4,655,917.607 

4,188,338.994 

1,160,604.374 

-4,655,916.161 

4,188,338.876 

E 

1,160,084.380 

-4,655,635.664 

4,188,722.464 

1,160,083.830 

-4,655,634.217 

4,188,722.346 

F 

1,160,787.133 

-4,655,565.726 

4,188,637.156 

1,160,786.583 

-4,655,564.279 

4,188,637.038 

G 

1,160,648.640 

-4,656,192.596 

4,188,040.975 

1,160,648.090 

-4,656,191.149 

4,188,040.857 

B 




1,160,636.707 

-4,655,589.358 

4,188,659.259 


SOLUTION First Iteration: Using station A’s coordinate values, T 0 is 


1,160,604.924- 1,160,604.374' 


0.550' 

-4,655,635.664 + 4,655,634.217 

= 

-1.446 

4,188,338.994 -4,188,338.876 


0.118 


The J and K matrices are 


1160604.374 

0.000 

-4188338.876 

-4655916.161 

1 

0 

o" 

-4655916.161 

4188338.876 

0.000 

-1160604.374 

0 

1 

0 

4188338.876 

4655916.161 

1160604.374 

0.000 

0 

0 

1 

1160083.830 

0 

-4188722.346 

-4655634.217 

1 

0 

0 

-4655634.217 

4188722.346 

0 

-1160083.830 

0 

1 

0 

4188722.346 

4655634.217 

1160083.830 

0 

0 

0 

1 

1160786.583 

0 

-4188637.038 

-4655564.279 

1 

0 

0 

-4655564.279 

4188637.038 

0 

-1160786.583 

0 

1 

0 

4188637.038 

4655564.279 

1160786.583 

0 

0 

0 

1 

1160648.090 

0 

-4188040.857 

-4656191.149 

1 

0 

0 

-4656191.149 

4188040.857 

0 

-1160648.090 

0 

1 

0 

4188040.857 

4656191.149 

1160648.090 

0 

0 

0 

1 


0.000 

0.000 

0.000 

0.000 

- 0.001 

0.000 

0.000 

- 0.001 

0.000 

0.000 

- 0.001 

0.000 
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Solving Equation (11.37) using the above matrices and adding X to the initial 
values results in 


X = 


-0.0000001095 

s = 

-0.0000001448 

0 1 = 

-0.0000000383 

e 2 = 

-0.0000001220 

8 3 = 

-0.6013 

Tx = 

-0.0458 

Ty = 

1.1773 

Tz = 


1 - 0.0000001095 = 0.9999998905 
-0°00'00.029867" 

-0°00'00.007896" 

-0°00'00.025165" 

0.550-0.6013 = -0.0513 
-1.446-0.0458 = -1.4918 
0.118+ 1.1773 = 1.2953 


The next iteration resulted in negligible changes in the unknowns, and thus 
the transformation parameters are as listed. Using Equation (24.2), transfor¬ 
mation parameters and the GNSS-derived ITRF 08 coordinates for station B , 
the NAD 83 coordinates 2 for station B are 

geocentric coordinates = (1,160,637.2568, -4,655,590.8052, 4,188,659.3772) 
geodetic coordinates = (41°18’40.46653" N, 76°00’05.50185" W, 319.677 m) 
SPCS 83 coordinates = (746,397.796 m, 128,586.853 m) 

The reader should note that the NAD 83 coordinates for Station B are the 
same as those listed in Figure 23.5. Elowever, slight differences in coordinates 
can be expected due to random errors in the transformation. 


Example 24.1 demonstrates the mathematical relationship between the two 
reference frames for this limited set of points. This process should always be 
considered when combining traditional observations with GNSS coordinates 
for higher-order surveys. That is, if GNSS-derived coordinates are to be entered 
into an adjustment, they should first be transformed into the local datum. 
In the United States, the National Geodetic Survey has developed horizontal 
time-dependent positioning (EITDP) software, 3 which allows the users to trans¬ 
form coordinates between several reference frames. This software transforms 
points for different epochs in time by also taking into account plate tectonics 
and applying velocity vectors to the parameters. 

The process of transforming points from global reference frames to local 
reference frames is important when performing real-time satellite stakeout 
surveys, or trying to match coordinates from an earlier survey, which was 
performed using a different reference frame. A satellite survey implicitly uses 
the points located in a global datum. Since engineering plans are generally 
developed in a local datum such as NAD 83, the GNSS-derived coordinate 

2 Equations to convert geocentric coordinates to geodetic coordinates can be found in Section 17.5. 
Appendix F has equations to convert geodetic coordinates to state plane coordinates. 

3 A description of the HTDP software can be located on the NGS website at http://www 
.ngs.noaa.gov/TOOLS/Htdp/Htdp.shtml. A Mathcad® worksheet that demonstrates this soft¬ 
ware is available on the book’s companion website. 
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values must be transformed into the local coordinate system. This process is 
known as localization (sometimes called site calibration) by manufacturers. 
From a design point of view, it is important to recognize that the best results 
will be obtained if points common in both reference frames surround the 
project area. After entering in the local datum coordinates, the GNSS receiver 
should occupy each station. The software then computes the transformation 
parameters and uses these to determine the coordinate values for the points to 
be surveyed or laid out. Section 24.5 discusses an alternative method used by 
manufacturers to accomplish this transformation. 


24.3 ROTATIONS BETWEEN COORDINATE SYSTEMS 


GNSS uses the geocentric coordinate system and provides baseline vectors in 
this system. Often, it is preferable to obtain the coordinate value changes in 
terms of geodetic coordinates. From geodesy, the relationship between changes 
in the geodetic coordinate system and the geocentric coordinate system is 


dx = 


dX 

dY 

dZ 


—(M + h ) sin cp cos A 
—(M + h) sin tp sin A 
(M + h) cos cp 


-(N + h) cos (p sin A 
—(N + h) cos (p cos A 
0 


cos (p cos A 
cos cp sin A 
sin (p 


cl(p 

dA 

dh 


— Rxg 


dip 

dA 

dh 


(24.8) 


where dx represents the changes in the geocentric coordinates, M the radius 
in the meridian, N the radius in the normal at latitude <p as given by 
Equation (23.16), h the geodetic height of the point, and R XG the transforma¬ 
tion matrix. 

The transformation between changes in the geodetic coordinate system and 
the local geodetic coordinate system are given in Equation (23.29), which is 
repeated here for convenience. 


dn 


M + h 

0 

0 

dcp 

de 

= 

0 

(N + h) cos cp 

0 

dA 

du 


0 

0 

1 

dh 


- Rlg 


dip 

dA 

dh 


(24.9) 


where R LG is the rotation matrix between the geodetic and local geodetic coor¬ 
dinate systems. 
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24.4 COMBINING GNSS BASELINE VECTORS WITH TRADITIONAL 
OBSERVATIONS 

As discussed in Chapter 23, the three-dimensional geodetic adjustment 
allows the adjustment of all traditional surveying observations. If the control 
is known in the local coordinate system, then Equation (24.2) can be included 
in adjustment to account for datum differences. 

Baseline vectors are the geocentric coordinate differences between two 
points. Thus, the translation component of Equation (24.2) is removed leaving 
only the scaling and rotational parameters. Therefore, the last three columns 
of the Jj matrix in Equations (24.6) and (24.7) can be eliminated leaving 


/,= 


Xi 0 -z t y t 
y t z t 0 -x t 
A -y t x t 0 


; dx = 

As 

A0 1 

A0 2 

- 

A6>3 


(24.10) 


Equation (24.10) can be used in Equation (24.6). Elowever, since the three- 
dimensional geodetic network adjustment is performed in the local geodetic 
coordinate system, the rotational elements of Equation (24.10) can be trans¬ 
formed about a single station in this system. Dropping the A symbol, the 
rotation about the single station in the local geodetic system becomes 


R = RlU 0 )RT(90 - <p 0 )R 3 (O u )R 2 (6 ^(0^(90 - 4> 0 )R 3 U 0 ) (24.11) 

where 0 n is a rotation about the north axis of the local geodetic coordinate 
system, 6 e a rotation about the east axis of the local geodetic coordinate 
system, 0 U a rotation about the up axis of the local geodetic coordinate system, 
R x , R 2 , and R 2 the rotation matrices defined in Section 18.7, and 0 O and A 0 
the geodetic coordinates of the rotational point. This point should be picked 
near the center of the project area. 

Again since in nearly aligned coordinate systems the rotations are small, the 
above rotations can be simplified to 

R = 0 n R n + 6 e R e + 6 U R U + / (24.12) 


where 


R 


U 


0 

- sin 0 O 
cos 0 o sin A 0 


sin 0 O 
0 

— COS 0o COS Aq 


- cos 0 O sin A 0 
cos 0o cos A 0 


0 


0 0 

0 0 

cos A 0 sin A 0 


R, 


cos Aq 
- sin A 0 
0 
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R 


n 


o 

COS 0 O 
sin 0 O sin 2 0 


- cos 0 O 
0 

- sin 0o cos A 0 


- sin 0 O sin A 0 
sin 0 O cos A 0 


0 


/is a three dimensional identity matrix, 0 n , 9 e , and 8 U are in radian units, and 
0 O and A 0 the geodetic coordinates of the rotational point. 

Finally, the transformation going from the observed GNSS vector to its local 
geodetic equivalent between stations / and J is 


A X u 


A X u 

A Y,j 

= (1 +s)R 

A Yjj 

A Z u 

2 

A- Z u 


where s represents the differential scale change between system 1 and 2, R is 
defined in Equation (24.12), [-]j represents the GNSS baseline vector compo¬ 
nents in the local coordinate system, and [-] 2 represents the GNSS observed 
baseline vector components between stations / and J. 

In the preceding chapter, the three-dimensional geodetic network adjust¬ 
ment was developed in the local geodetic system. Thus, the addition of the 
GNSS baseline vectors into this adjustment requires that the coefficient matrix 
be rotated into the same system. Recall from Chapter 17 that the coefficient 
matrix (A) for each GNSS baseline vector consisted of three rows containing 
-1,0, and 1. The matrix, as presented in Chapter 17, must be rotated into 
the local geodetic system. Thus, for the baseline vector //, the new coefficient 
matrix values are derived as 


For station/: - (1 + s)R ■ R XG ((t>„ A,) ■ R LG ((p,) 1 
For station J: (1 + s)R ■ R XG (cpj, Aj) ■ R LG (0 7 ) _1 


(24.14) 


where s is the change in scale between the two systems, rotation matrix R 
defined in Equation (24.12), rotation matrix R XG defined in Equation (24.8), 
rotation matrix R LG defined in Equation (24.9), and (0„ A t ) and (0,-, Aj) the 
geodetic coordinates from stations / and /, respectively. 

When developing the matrices for a least squares adjustment, the unknown 
parameters for scale and rotation should be set to zero. After the first itera¬ 
tion these values will be modified and updated. At the end of the adjustment, 
these parameters can be checked for statistical significance, as was described in 
Section 18.8. 

The elements of the coefficient matrix for the unknown rotation angles and 
scale are 


J = 


Xj-Xj 


y, 

Z, 


«2 

r 

«3 


U 2 


(24.15) 
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where 


jr T = [As A e n A0 e A9 U ] , 


1 


1 


1- 

1 

Yj-Yi 

II 

Yj-Yj 


Yj-Yj 

l 

1_ 


Zj - z, 


l 

N 

►-i 

1_ 


Example 24.2 The local datum coordinates for station B are given in Example 
24.1 and the GNSS-derived and transformed approximate NAD 83 coordi¬ 
nates for station E are (41°18'43.9622" N, 76°00'29.0384" W, 292.354 m). 
Assuming initial values of zero for the scale and rotation parameters in 
Equation 24.13 and using point A as the rotational point, develop the coeffi¬ 
cient ( J) and constant’s (K) matrices for the transformation parameter and the 
following GNSS-observed baseline. 


Baseline 

AX (m) 

AT (m) 

A Z (m) 

EB 

552.8771 

44.8606 

-63.0862 


SOLUTION From Example 24.1, the approximate NAD 83 geocentric and 
geodetic coordinates for station E and B are 


Station 4> 

A 

h (m) 

E 

41°18'43.9622" 

-76°00'29.0384" 

292.354 

B 

41°18'40.4665" 

-76°00'05.5018" 

319.677 

A 

41°18'26.0485" 

-76°00'10.2486" 

— 

By Equation (24.8), R XG for station B is 



'-1,016,184.4652 

4,655,590.8055 

0.1817' 

Kg = 

4,076,156.4565 

-1,160,637.2580 

-0.7288 

4,779,908.9967 

0.0000 

0.6601 

By Equation (24.8), R XG for station E is 



-1,015,734.7310 

4,655,634.2161 

0.1816' 

II 

=4 

4,076,334.1770 

-1,160,083.8309 

-0.7288 

4,779,818.0865 

0.0000 

0.6602 
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By Equation (24.9), R LG for station B is 


R 


B 

LG ~ 


6,363,584.8656 0.0000 

0.0000 4,798,083.4291 
0.0000 0.0000 


0.0000 

0.0000 

1.0000 


By Equation (24.9), R LG for station E is 


R 


E 

LG ~ 


6,363,558.6197 0.0000 

0.0000 4,797,991.7099 
0.0000 0.0000 


0.0000 

0.0000 

1.0000 


Since the initial approximations for the three differential rotations and scale 
are initially 0, the R matrix in Equation (24.12) reduces to a 3 X 3 identity 
matrix for the first iteration. In subsequent iterations, this matrix will change. 

Combining the data from Table (23.3) with the GNSS baseline vectors of 
Example 24.1 yields a / matrix with 19 columns where the unknown parameters 
are 

\dX A dY A dZ A dX B dY B dZ B dX c ... dZ D dX E dY E dZ E ... 5 9„ 6 e 0„] T 

The / coefficient matrix for baseline EB is 



0 

0 

0 

«11 

a \2 

a l3 

0 ■ 

■ 0 

a,4 

fl 15 

fl 16 

0 ■ 

■ 0 

*11 

*12 

*13 

*14 


J = 

0 

0 

0 

a 2\ 

a 22 

a 23 

0 ■ 

■ 0 

a 24 

a 25 

a 26 

0 ■ 

■ 0 

*21 

*22 

*23 

*24 

( 24 . 16 ) 


0 

0 

0 

«31 

a 12 

a 33 

0 ■ 

■ 0 

a 34 

fl 35 

fl 36 

0 ■ 

■ 0 

*31 

*32 

*33 

*34. 



where, using Equation (24.14), the coefficients for A are 


A = 


-0.1597 0.9703 0.1817 0.1596 -0.9703 -0.1816 

0.6405 -0.2419 -0.7288 -0.6406 0.2418 0.7288 

0.7511 0.0000 0.6601 -0.7511 0.0000 -0.6602 


and, using Equation (24.15), the coefficients for the transformation parameters, 


B , are 


B = 


553.4271 -72.9412 15.2308 -17.2421 

43.4106 405.6700 -61.1002 -376.7564 

-62.9699 -361.3992 91.7378 -411.2673 


With the aid of Equations (17.2) through (17.4), the geocentric coordinates 
for stations E and B are 


Station 

X(m) 

Y( m) 

Z( m) 

E 

1,160,083.8309 

-4,655,634.2161 

4,188,722.3464 

B 

1,160,637.2580 

-4,655,590.8055 

4,188,659.3765 















556 COMBINING GNSS AND TERRESTRIAL OBSERVATIONS 


The values for the constant matrix ( K) are 



552.8771 - (1,160,637.2580 - 1,160,083.8309) 


-0.5500 

K = 

44.8606 - (-4,655,590.8055 + 4,655,634.2161) 

= 

1.4500 


-63.0862 - (4,188,659.3765 - 4,188,722.3464) 


-0.1163 


Notice that the coefficient matrix for each GNSS baseline vector component 
is no longer a matrix of -1, 0, and 1, but rather contain noninteger values. 
Also note that the coefficients for the differential changes in scale and rotations 
are populated for each baseline vector component. The reader may wish to 
review the Mathcad® worksheet C24.xmcd on the book’s companion website 
to explore the complete set of matrix operations. 


24.5 ANOTHER APPROACH TO TRANSFORMING COORDINATES 
BETWEEN REFERENCE FRAMES 

The Helmert transformation discussed in Section 24.2 is the most 
rigorous method of converting between reference frames. However, many 
GNSS software manufacturers have broken this problem into their horizontal 
and vertical components. This method is especially useful when the local 
coordinates are in some arbitrarily created temporal coordinate system. To 
effect this transformation, the satellite-derived geodetic coordinates must 
be transformed into two-dimensional Cartesian coordinates through the 
use of a map projection system. Often, a stereographic map projection (see 
Appendix F.4) is used to convert the GNSS-derived latitude and longitude of 
stations into local coordinate system values of ne. 

The oblique stereographic map projection uses a plane as its developable 
surface. It is defined by its grid origin and scale factor. Typically, the average 
of the control station’s latitudes and longitudes are used to define the origin 
of the projection. To minimize the scaling differences between the distances 
observed conventionally with those derived from satellites, the map projection 
coordinate system is brought to the surface using the average height of the 
project control. This is accomplished using a defining scaling factor for the 
map projection system of 

*-l + 5= (24.17) 

J\ e 

where k 0 is the scale factor used to define the oblique stereographic map 
projection, H avg the average orthometric height of the project, and R e the 
average radius of the Earth at the origin of the coordinate system. 

The transformation process involves observing stations using a GNSS 
receiver that already has coordinates that are defined in the arbitrary/local 
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coordinate system. The satellite-derived coordinates are then used to define 
the map projection system. Following this, the satellite-derived map projection 
coordinate values are transformed into the local coordinate system using a 
two-dimensional conformal coordinate transformation from Section 18.2. 
Flowever, the general least squares approach may provide a better transfor¬ 
mation since both systems of coordinates can contain observational errors. 
Using either method, the satellite-derived plane coordinates are brought 
into the local horizontal coordinate system. Subsequently, these transforma¬ 
tion parameters are used to transform the remaining satellite-derived map 
projection coordinates into the aribtrary/local coordinate system. 

Once the horizontal transformation is completed, the satellite-derived 
heights must also be transformed into local elevations. To do this, at least 
three points with known local elevations must be observed to determine their 
satellite-derived geodetic heights. These geodetic heights are then converted 
into orthometric heights using an appropriate geoid model and Equation 
(23.39) rearranged as 

H = h-N (24.18) 


where H is the station’s orthometric height, h the geodetic height, and N the 
geoidal separation determined from a geoid model for that station. These three 
points determine a level surface that is oblique to the surface as determined 
by the same points using their local orthometric height values. This obliq¬ 
uity is caused by deflection of the vertical (see Section 23.6) and is corrected 
by applying two rotations in the cardinal directions. A translation between 
the two systems completes the transformation. The linear transformation is 
computed as 

r eN GPS + r nE gPS + T = H Lo cat ~ H GPS + v (24.19) 


where Tis the translation between the two level surfaces, r e and r n the rotations 
in the east and north directions, N GPS , E GPS , and H GPS , the satellite-derived 
local map projection coordinates of the stations having orthometric heights as 
determined by Equation (24.18) of H GPS , H Local the local orthometric height 
of the station, and v the residual error determined after the transformation. 


Example 24.3 Four stations with state plane coordinates and orthometric 
heights determined by conventional surveying are also occupied with a GNSS 
receiver to determine their geodetic coordinate values. The satellite-derived 
geodetic heights are converted to orthometric heights using Equation (24.18). 
Using the average of the satellite-derived coordinate values, an oblique stereo¬ 
graphic map projection system is defined with a grid origin of (41° 18'44.28403" 
N, 76°00' 18.69234" W) and a scaling factor of 1.000050598 where a Gaussian 
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mean radius 4 of the Earth at 41° 18'44.28403" N latitude is used as the radius of 
the Earth. The satellite geodetic coordinate values are then transformed into a 
map projection coordinate system. The resulting coordinates are shown in the 
following table. What are the transformation parameters for the localization 
and the residuals for the control points? 


Satellite Coordinates Local Coordinates 


Station 

X (m) 

Y( m) 

h (m) 

E( m) 

7V(m) 

h (m) 

A 

49.916 

-141.948 

339.845 

441.616 

1807.534 

340.500 

E 

-387.185 

410.711 

291.690 

223.893 

2022.852 

292.354 

F 

311.626 

279.250 

312.076 

532.227 

2003.068 

312.731 

G 

25.655 

-547.996 

350.268 

452.616 

1631.044 

350.935 


SOLUTION Following Equation (18.5) and the procedures outlined in 
Section 18.2, a two-dimensional conformal coordinate transformation is 
performed. The resulting transformation parameters are a = 0.43139044, 
b = 0.05283832, T E = 412.587 m, and T N - 1866.123. These transforma¬ 
tion parameters in conjunction with satellite-derived positions can be used 
to transform all other observed points into the local coordinate system. 
Following this, the transformation between the level surfaces is developed 
using Equation (24.18) as 


-141.948 

49.916 

1 

r 


340.500- 339.845 

410.711 

-387.185 

1 

r e 


292.354-291.690 

279.250 

311.626 

1 

^n 
T 


312.731 - 312.076 

-547.996 

25.655 

1 

1 


350.935 - 350.268 


Using Equation (11.32), r e = -1.574", r n = -3.205", and T = 0.660 m. The 
resulting residuals for both transformations are 


Station 

N{ m) 

E (m) 

m) 

A 

-0.009 

0.004 

0.006 

E 

-0.010 

-0.035 

-0.001 

F 

-0.014 

0.038 

-0.002 

G 

0.034 

-0.007 

-0.003 


4 The Gaussian mean radius is defined as R = yMN, where M is the radius of the meridian and 
TV the radius of the normal defined in Equation (23.16). 
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Following these two adjustments, the residuals should be examined for 
blunders. It should be remembered when doing this that both sets of coordi¬ 
nates have observational errors. For example, in a real-time satellite survey, 
the estimated accuracy of the coordinates is between 1 and 2 cm. Additionally, 
the application of the geoid model in Equation (24.18) can add two or more 
centimeters of error to the orthometric heights derived using this equation. 
Similarly, the local coordinates contain errors that are dependent on the 
held procedures followed, the quality of the instruments, and abilities of the 
observer. Thus, the residuals shown above may be considered acceptable for 
the survey procedures. 

In Example 24.3, an unweighted adjustment model was used since the 
stochastic model for the conventional and satellite surveys were unknown. 
However, if the stochastic model is known, then a weighted adjustment would 
be appropriate. Since GNSS receivers provide estimates on the accuracies of 
their coordinates, the weighted adjustment given in Equation (11.35) would 
more appropriately be used. However, if estimates on the accuracies of the 
local coordinates are also known, then a general least squares approach as 
discussed in Chapter 22 would be more appropriate and would account for 
the errors in both systems of observations. 

On the companion website is the Mathcad worksheet® C24-2.xmcd, which 
demonstrates the solution to Example 24.3. It uses matrices to perform the 
computations and reads a data hie, which is shown to the right of where the 
data is initially read. Additionally, Example 24.3 is solved in the spreadsheet 
hie Example 24-3.xls. 


24.6 OTHER CONSIDERATIONS 

Using procedures similar to those shown in Chapter 23 and Example 24.2, a 
combined adjustment of both terrestrial and GNSS baseline vectors can be 
performed. If GNSS-derived station coordinates are to be held, they must first 
be transformed in the local datum to ensure consistency with any local control 
stations. However, if GNSS-derived points are the only control in the adjust¬ 
ment, then the entire adjustment can be performed using the global datum that 
was used to reduce the GNSS observations. 

In both chapters, the adjustments are performed in the local geodetic 
coordinate system. This system was chosen since dehning standard deviations 
for control stations in the («, e, u) system is more intuitive to surveyors 
than either the geodetic or geocentric coordinate systems. References in 
the bibliography at the end of this book contain procedures for combining 
GNSS and terrestrial observations using either the geocentric or geodetic 
systems. 
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PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

24.1 Discuss what is meant by a local reference frame. 

*24.2 Discuss what is meant by a global reference frame. 

24.3 How do local and global reference frames differ? 

24.4 What is meant by the term localization ? 

*24.5 Why is it important to localize a GNSS survey before staking out a 
highway alignment? 

*24.6 Using the Helmert transformation parameters derived in Example 
24.1, derive the NAD 83 geocentric coordinates (in meters) for a 
point having ITRF 08 coordinates of (1160652.008, -4655693.197, 
4188423.986). 

24.7 Same as Problem 24.6, except for a station having geocentric coordi¬ 
nates of (1160398.043, -4655803.184, 4188935.609). 

24.8 Using the accompanying data, compute the Helmert transformation 
parameters to take the coordinate values from WGS 84 to NAD 83. 




NAD 83 



WGS 84 


Sta 

X(m) 

Y( m) 

Z(m) 

X(m) 

Y( m) 

Z(m) 

100 

101 

102 

1,160,097.952 

1,160,285.844 

1,159,986.652 

-4,634,583.300 

-4,634,859.416 

-4,634,623.501 

4,188,086.049 

4,188,233.622 

4,188,153.783 

1,160,098.356 

1,160,286.248 

1,159,987.056 

-4,634,583.248 

-4,634,859.364 

-4,634,623.449 

4,188,086.233 

4,188,233.806 

4,188,153.967 


24.9 Using the accompanying data, compute the Helmert transformation 
parameters to take the coordinate values from WGS 84 to NAD 83. 


NAD 83 WGS 84 

Station X (m) Y (m) Z (m) X (m) Y (m) Z (m) 


1 

2 

3 

4 


1,097,860.137 -4,684,923.884 4,172,732.773 
1,099,114.170 -4,684,740.495 4,172,609.370 
1,097,936.268 -4,686,351.303 4,171,109.757 
1,098,941.388 -4,686,376.388 4,170,823.932 


1,097,859.116 -4,684,919.481 4,172,728.847 
1,099,113.147 -4,684,736.092 4,172,605.444 
1,097,935.246 -4,686,346.899 4,171,105.832 
1,098,940.366 -4,686,371.984 4,170,820.007 
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24.10 Using the appropriate information from Table 23.3, Example 24.2, 
and the accompanying baseline vector data, determine the nonzero 
elements of the coefficient (J) and constant (K) matrices. 


Baseline AX (m) A Y (m) 

A Z (m) 

ED 35.2573 -368.067 

-347.063 

Same as Problem 24.10, except for the following data. The approx- 

imate geodetic coordinates for Station F 
76°59'58.9973" W, 312.731m). 

are (41°18'39.7004" N, 

Baseline AX (m) A Y (m) 

AZ (m) 

FB -149.874 -25.079 

22.222 

Same as Problem 24.10, except for the following data. The approx- 

imate geodetic coordinates for station G 
76°00'11.2922" W, 350.935 m). 

are (41° 18'12.8871" N, 

Baseline AX (m) A Y (m) 

AZ (m) 

GD -529.004 188.868 

334.427 


24.13 Using Station A as the central point in a project and the baseline vec¬ 
tors given in Problem 24.10, what are the first iteration coefficients for 
the transformation parameters? 

24.14 Same as Problem 24.12, except use the baseline from Problem 24.11. 

24.15 Same as Problem 24.12, except use the baseline from Problem 24.12. 

24.16 List the steps outlined in Section 24.5 to localize satellite-derived geo¬ 
centric coordinates into a local coordinate system. 

24.17 Using the procedures discussed in Section 24.5 and the following data, 
determine the following: 

(a) Transformation parameters for the horizontal and vertical 
transformations. 

(b) Residuals of the transformed coordinates. 
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Satellite-Derived Coordinates Local Coordinates 


Station 

X(m) 

Y (m) 

h (m) 

^ (ft; 

TV (ft) 

h (ft) 

1 

-335.415 

-280.544 

40.3742 

7405.583 

6812.877 

248.31 

5 

-624.878 

-58.153 

31.9864 

6641.129 

7734.808 

221.29 

22 

202.292 

17.357 

40.7997 

9342.342 

7375.175 

249.81 

102 

757.950 

321.418 

59.9799 

11341.155 

7944.178 

312.56 


*24.18 Using the transformation parameters found in Problem 24.17, what 
are local coordinate values for a station with satellite-derived map 
projection coordinates of (-329.062, -29.321, 126.205) in units 
of meters? 

24.19 Repeat Problem 24.17 with the following data. 


Sta 

Satellite-Derived Coordinates 

Local Coordinates 


X(m) 

T(m) 

h (m) 

N (m) 

N(m) 

E( in) 

H(m) 

A 

-2678.662 

2175.270 

88.760 

-34.248 

107,835.569 

673,901.575 

122.998 

B 

1191.073 

3411.702 

100.080 

-34.278 

109,111.331 

677,758.273 

134.357 

C 

2988.168 

-2695.266 

80.380 

-34.318 

103,023.357 

679,617.475 

114.692 

D 

-1650.335 

-2748.906 

68.810 

-34.275 

102,922.409 

674,980.006 

103.080 

E 

150.457 

-141.428 

113.560 

-34.284 

105,547.975 

676,754.013 

147.837 


24.20 Using the transformation parameters found in Problem 24.18, what 
are local coordinate values for a station with satellite-derived oblique 
stereographic map projection coordinates? 


Station 

X(m) 

Y (m) 

h (m) 

N (m) 

1 

701.732 

-470.057 

102.330 

-34.291 

2 

1026.075 

-304.910 

108.150 

-34.293 

3 

1079.183 

797.099 

119.910 

-34.290 

4 

1372.298 

1028.858 

120.440 

-34.292 


24.21 Using the procedures discussed in Section 24.5 and the following data, 
determine the following: 

(a) Transformation parameters for the horizontal and vertical 
transformations. 

(b) Residuals of the transformed coordinates. 

(c) Local coordinates for station 5. 
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Satellite-Derived Coordinates 

Local Coordinates 

Sta 

E (m) 

N (m) 

h (m) 

E( m) 

N( m) 

h (m) 

1 

-866.174 

2,421.082 

167.945 

7,876.158 

6,449.579 

168.478 

2 

1,659.368 

2,093.530 

167.945 

10,111.902 

7,669.078 

168.433 

3 

-1,369.529 

-1,874.955 

160.935 

9,994.089 

2,678.123 

161.421 

4 

576.170 

-2,639.451 

164.288 

12,017.579 

3,203.297 

164.725 

5 

23.468 

-86.987 

165.658 





PROGRAMMING PROBLEMS 

24.22 Develop software that solves Problem 24.9. 

24.23 Develop software that solves Problem 24.19. 







CHAPTER 25 


ANALYSIS OF ADJUSTMENTS 


25.1 INTRODUCTION 

The initial adjustment of data is not the end of the adjustment. Rather, it is 
the beginning of the analysis process. Throughout this book, the mechanics 
of performing a least squares adjustment properly have been discussed. 
Additionally, statistical methods were introduced to analyze the quality of 
observations. As in Chapter 21, this chapter will explore the procedures used 
in analyzing the residuals of the observations in the adjustment. 


25.2 BASIC CONCEPTS, RESIDUALS, AND THE NORMAL 
DISTRIBUTION 

The normal distribution and statistical testing were introduced in the 
early chapters of this book using simple sets of data. These basic concepts also 
apply in the analysis of data after an adjustment. When viewing Figure 25.1, 
four guiding principles are used in analyzing observations from normally dis¬ 
tributed data: 

1. Data tend to be clustered around a single value. 

2. Errors tend to be distributed about this value equally. 

3. Errors are distributed in sign equally. 

4. Most errors tend to be small in magnitude and errors large in magnitude 
seldom occur. 
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/<*) 



At the conclusion of a least squares adjustment, the residuals in the 
observations should be scanned and analyzed in an attempt to locate outliers 
and blunders in the data. However, terms such as large in magnitude must be 
defined statistically. This is accomplished by comparing the observation’s a 
priori standard deviation against its residual using a /-distribution multiplier. 
For example, if a distance observation has a residual of +0.25 ft when all 
other residuals in the adjustment are below 0.10 ft, this observation may 
be viewed as large. However, if the observation had an estimated stan¬ 
dard deviation of only ±0.5 ft, then its residual is well within its estimated 
range. 

As an example, the results of the adjustment from Example 16.2 will be 
analyzed. A quick review of the residuals listed for the distance observations 
in Figure 25.2 shows that the residual for distance QR is at least twice the 
size of the other distance residuals and might be viewed as large. However, 
the a priori standard deviation of this observation was ±0.026 ft from an 
adjustment with 13 redundant observations. Thus, the 99% confidence interval 
for this observational residual is computed as 

b)9% ±6) 005 13 *-* = ±3.012(0.026) = ±0.078 It 

From this, it can be shown that the residual of -0.038 ft for distance QR is 
well within the 99% confidence interval of ±0.078 ft. 

When analyzing the angles, it can be seen QTR has a residual of 18.52". This 
residual is more than three-times larger than the next largest residual of 5.23". 
Also note that this angle opposes distance QR. Therefore it may explain why 
distance QR had the largest distance residual. The a priori estimated standard 
deviation for angle QTR is ±4.0". Using the same /-distribution critical value 
for a 99% confidence interval yields 


v 95% = 3.012(4.0") = ±12.0" 
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******************************* 

Adjusted Distance Observations 
******************************* 

Station Station 


Occupied 

Sighted 

Distance 


! 

1 

1 

1 

t 

t 

i < 

1 

1 

1 

1 

S 


Q 

R 

1,639.978 


-0.0384 

0.0159 


R 

S 

1,320.019 


0.0176 

0.0154 


S 

T 

1,579.138 


0.0155 

0.0158 


T 

Q 

1,664.528 


0.0039 

0.0169 


Q 

S 

2,105.953 


-0.0087 

0.0156 


R 

T 

2,266.045 


0.0104 

0.0163 


************* 

************** 





Adjusted Angle Observations 





************* 

************** 





Station 

Station 

Station 





Backsighted 

Occupied 

Foresighted 


Angle 

V 

S 

R 

Q 

S 

38° 

48* 52.8" 

2.08" 

1.75 

S 

Q 

T 

47° 

46* 13.1" 

0.70" 

1.95 

T 

Q 

R 

273° 

24' 54.1" 

-2.37" 

2.40 

Q 

R 

S 

269° 

57' 34.0" 

0.64" 

2.26 

R 

S 

T 

257° 

32' 57.3" 

0.50" 

2.50 

S 

T 

Q 

279° 

04’ 34.5" 

3.32" 

2.33 

S 

R 

T 

42° 

52' 52.3" 

1.34" 

1.82 

S 

R 

Q 

90° 

02’ 26.0" 

-0.74" 

2.26 

Q 

S 

R 

51° 

08' 41.3" 

-3.73" 

1.98 

T 

s 

Q 

51° 

18' 21.4" 

5.23" 

2.04 

Q 

T 

R 

46° 

15' 20.5" 

18.52" 

1.82 

R 

T 

S 

34° 

40’ 05.0" 

-0.74" 

1.72 


FIGURE 25.2 Adjusted distances and angles from Example 16.2. 


The actual residual for angle QTR is well outside the range of ±12". In this 
case, the residual for angle QTR definitely fits the definition of “large” and is a 
candidate for reobservation or removal from the adjustment. 

Using the procedures outlined in Chapter 21, data snooping confirms that 
angle QTR is a detectable blunder. This angular observation can be removed 
from the data set and the adjustment rerun. The results of this readjustment 
are shown in Figure 25.3. Note that the residual for distance QR was reduced 
by about half of its previous value after angle QTR was removed. This 
demonstrates the interrelationship between the distance QR and angle QTR. 
Also note that all the residuals are within a single standard deviation of their 
a priori estimated values. In fact, all the distance residuals are less than a third 
of their a priori estimated errors and all the angle residuals are less than half 
their a priori estimates. 

There are 18 observations in this adjustment. Thus, about half of the 
residuals (9) should be positive, while the others are negative in sign. In this 
adjustment there are exactly nine positive residuals and nine negative resid¬ 
uals. This follows the second guideline for normally distributed data. In this 
example, the residuals are not skewed as discussed in Section 2.4. 

Example 25.1 A baseline vector determined by the rapid-static surveying 
method (5 mm + 1 ppm) has a length of about 10.5 km. The instrument 
setups were estimated to be within ±3 mm of the station’s true location. Its 
combined XYZ residual is 0.021 m. At a 99% level of confidence, should 
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this residual be considered too large if the number or redundancies in the 
adjustment is 20? 1 

SOLUTION The a priori estimated error in this baseline using the 
rapid-static method is 


/ 3 2 + 3 2 + 5 2 + 


10,500,000 y 
1,000,000 / 


:12.4mm and 


^o.oo 5,20 - 2.84 


The acceptable 99% range is R = 2.84(12.4) = ±35.2 mm. The residual was 
21 mm. This is inside of the 99% confidence interval and is an acceptable size 
for a residual from a baseline of this length observed using the rapid-static 
surveying method. 


25.3 GOODNESS OF FIT TEST 

The results of the adjustment in Figure 25.3 appear to follow the normal 
distribution, and the sizes of the residuals indicate that the data appears to be 
consistent. However, the adjustment failed to pass the goodness of fit test. This 
demonstrates a weakness in the x 2 test. That is, passing or failing the test is 
not a good indicator of the quality of the data or the presence of blunders. 
Nor does the test reveal the exact problem in data when the test fails. The x 2 
test should be viewed as a warning flag for an adjustment that requires further 
analysis and not an indicator of problems with the data. 

As discussed in Chapters 5 and 16, the x 2 test compares the a priori reference 
variance, set equal to one, against the reference variance computed from the 
data. An analysis of Equation (12.15) shows that the test will fail if the residuals 
are too large or too small compared to the weights of the observations. For 
example, an observation with a small residual should have a high weight and a 
large residual should have a low weight. If the residuals tend to be smaller than 
their a priori standard deviations, then the resulting reference variance will be 
less than one, most likely. This is an example of an incorrect stochastic model, 
which occurred in Example 16.2 discussed previously. If the residuals tend to 
be larger than their a priori standard deviations, the reference variance will be 
greater than one and the x 2 test will fail in the upper bounds of the distribution. 

The original set of data in Example 16.2 failed the goodness of fit test. In 
the first adjustment, it failed because the computed reference variance was 
greater than one. This was probably caused by the large residual for angle QTR. 

1 It should be realized that most baseline vectors are determined from several epochs of data involv¬ 
ing a multitude of satellites. In these cases, the number of redundant observations is typically 
over 30, and the critical t from the normal distribution can be used to determine the estimated 
error in a baseline vector. 
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Adjusted stations 
Station X 


Error ellipse confidence level at 0.9S0 
Y Sx Sy Su Sv t 


R 

1, 003.06 

2, €40.01 

0.000 

0.00€ 

0.017 

0.000 

0.11' 

S 

2,323.0€ 

2, €38.47 

0.005 

0.007 

0.019 

0.014 


T 

2,€€1.74 

1,09€.09 

0.00€ 

0.007 

0.021 

0.015 

2€. 18' 


Adjusted Distance Observations 
Station Station 


Occupied 

Sighted 

Distance 

V 

s 

Std.Res. 

Red. # 

Q 

R 

1,€40.008 

-0.0081 

0.0060 

-0.409 

0.57€ 

R 

S 

1,320.00€ 

0.0054 

0.0055 

0.295 

0.579 

S 

T 

1,579.133 

0.0099 

0.00 5 € 

0.510 

0.597 

T 

Q 

1,€€4.514 

-0.0097 

0.00€0 

-0.495 

0.5€9 

Q 

s 

2,105.9€€ 

0.0039 

0.00 5 € 

0.1€2 

0.702 

R 

T 

2,2€€.034 

-0.0014 

0.0058 

-0.057 

0.700 

Adjusted Angle Observations 





Station 

Station 

Station 





Backsighted 

Occupied 

Foresighted 

Angle 

V 

S Std.Res. Red. # 

R 

Q 

S 38* 

48* 50.2" 

-0.45" 

0. €4 

-0.13 0.795 

S 

Q 

T 47* 

4€* 11.7** 

-0.73" 

0. €9 

-0.21 0.757 

T 

0 

R 273* 

24*58.1" 

1.58" 

0.89 

0.44 0.€72 

0 

R 

S 2 €9* 

57*34.7" 

1.31" 

0.80 

0.32 0.7€7 

R 

S 

T 257' 

32 * 5€.9" 

0.11" 

0.88 

0.03 0.71€ 

S 

T 

Q 279* 

04*30.3" 

-0.91" 

0.87 

-0.24 0.700 

S 

R 

T 42' 

52*52.€" 

1.58" 

0. €4 

0.41 0.821 

S 

R 

Q 90* 

02*25.3" 

-1.41" 

0.80 

-0.3€ 0.74€ 

Q 

S 

R 51* 

08*44.5" 

-0.53" 

0.73 

-0.14 0.7€7 

T 

S 

Q 51' 

18*18.€" 

2.43" 

0.74 

0.71 0.722 

R 

T 

S 34* 

40*04.3" 

-1.37" 

0. €1 

-0.38 0.814 

Adjusted Azimuth Observations 





Station 







Occupied 

Sighted 

Azimuth 

V 

S" 

Std.Res. 

Red.# 

Q 

R 

0* 0€ *24.5" 

-0.00" 

0.00" 

’ 0.0 

0.000 


Adjustment Statistics 


Iterations = 2 
Redundancies = 12 

Reference Variance = 0.1243 
Reference So * ±0.35 

Failed to pass X* test at 95.0% significance level! 
X‘ lower value =4.40 
X* upper value = 23.34 


FIGURE 25.3 Readjustment of data in Example 16.2 after removing angle QTR. 


After angle QTR was removed from the data, the x 2 test failed because the 
reference variance was statistically less than one. Since the residuals appear to 
be much smaller than their a priori standard deviations, an incorrect stochas¬ 
tic model is the cause for the failure. In this case, the distance residuals were 
about three times less than the estimated standard deviations, and the angles 
were one-half of their estimated standard deviations. Thus, to pass the x 2 test 
with this adjustment, the stochastic model needs to be modified. 
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In developing the stochastic model for this problem, it was originally 
believed that the held crew had used a total station with an ISO 17123-3 
accuracy of ±4" and EDM accuracy of 5 mm + 5 ppm. It was later discov¬ 
ered that the crew used an instrument having an ISO 17123-3 accuracy of 
±2" and EDM accuracy of 2 mm + 2 ppm. Estimated standard deviations 
using this new information resulted in the adjustment shown in Figure 25.4. 
This adjustment passed the goodness of fit test. However, by closely examining 


Adjusted stations 





Error 

ellipse confidence 

level at 0.950 

Station 

X 

Y 

Sx 

Sy 

Su 

Sv t 

R 

1,003.06 

2,640.00 

0.000 

0.009 

0.024 

0.000 0.11' 

S 

2,323.06 

2,638.47 

0.008 

0.009 

0.028 

0.021 151.27* 

T 

2,€61.74 

1,096.09 

0.008 

0.011 

0.031 

0.022 26.14* 

Adjusted Distance Observations 





Station 

Station 






Occupied 

Sighted 

Distance 

V 

S 

Std.Res. 

Red.* 

Q 

R 

1,640.008 -0.0083 

0.0086 

-0.830 

0.580 

R 

S 

1,320.006 

0.0053 

0.0081 

0.527 

0.603 

S 

T 

1,579.133 

0.0100 

0.0081 

0.971 

0.615 

T 

Q 

1,€64.515 

-0.0089 

0.0087 

-0.895 

0.568 

Q 

s 

2,105.966 

0.0039 

0.0079 

0.341 

0.673 

R 

T 

2,266.034 

-0.0011 

0.0082 

-0.097 

0.658 

Adjusted Angle Observations 





Station 

Station 

Station 





Backsighted 

Occupied Foresighted 

Angle 

V 

S Std.Res. Red.* 

R 

Q 

S 38' 

48*50.2" 

-0.46" 

0.95 

-0.24 0.808 

S 

Q 

T 47' 

46*11.7" 

-0.73" 

1.02 

-0.38 0.776 

T 

Q 

R 273' 

24*58.1" 

1.59" 

1.29 

0.87 0.667 

Q 

R 

S 269* 

57*34.7" 

1.27" 

1.14 

0.64 0.751 

R 

S 

T 257' 

32*56.8" 

0.03" 

1.27 

0.02 0.696 

S 

T 

Q 279' 

04*30.4" 

-0.79" 

1.25 

-0.43 0.684 

s 

R 

T 42* 

52*52.6" 

1.55" 

0.94 

0.77 0.820 

s 

R 

Q 90* 


-1.37" 

1.14 

-0.69 0.751 

Q 

S 

R 51' 

08*44.4" 

-0.57" 

1.06 

-0.29 0.772 

T 

S 

Q sr 

18*18.7" 
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FIGURE 25.4 Readjusted data from Example 16.2 with a different stochastic model. 
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the two adjustment, this did not change the adjustment results significantly. 
That is, the adjusted coordinate values and adjusted observations are nearly 
the same in the adjustments shown in Figures 25.3 and 25.4. What did change 
in Figure 25.4 were the statistical results. Since the statistical results of the 
adjustment are of little value to the surveyor once analyzed, the adjustment 
shown in Figure 25.3 is sufficient for most applications. 

Practitioners often view the goodness of fit test as an indicator of a possible 
problem. If the goodness of fit test failed because the computed reference vari¬ 
ance was too small, the test result is often ignored since correcting it does not 
change the adjusted coordinates significantly. In this case, some practitioners 
will say that the adjustment failed the goodness of fit test on the “good” side. 
That is, the reference variance was too small because the residuals are too small. 
However, if the computed reference variance is greater than one, the results 
should be analyzed for possible blunders in the observations. After the identi¬ 
fiable blunders have been eliminated from the set of data, the stochastic model 
might still exhibit a problem. In this case, if the computed reference variance is 
greater than 1, the estimated standard deviations for the observations should 
be increased. In the preceding example, the computed reference variance is less 
than 1. To correct this, the estimated standard deviations for the observations 
were decreased. By doing this, the surveyor can achieve a correctly weighted 
least squares adjustment. 

This adjustment brings about another important discussion point. Had all 
the a priori standard deviations been reduced by a single scale factor, the results 
of the adjustment would be the same. 2 That is, if the a priori standard devia¬ 
tions for all the observations had been cut in half, this would have resulted 
in increasing all the weights by a factor of four. Since weights are relative, 
performing a scalar reduction in the standard deviations does not change the 
adjustment. 

This example demonstrates the importance of selecting appropriate a pri¬ 
ori standard deviations for the observations. Estimated standard deviations for 
observations cannot be selected from the recesses of one’s mind. Doing this not 
only affects how the errors in the observations are distributed but also how the 
results of the adjustment are analyzed. For traditional surveys, it is always best 
to select a stochastic model that reflects the estimated accuracies in the observa¬ 
tions using procedures discussed in Chapters 7 and 9. Good estimates of setup 
errors will result in a sound stochastic model typically. 

However, the network adjustment of baseline vectors derives its stochas¬ 
tic model from the least squares reduction of each baseline. As discussed in 
Chapter 17, the stochastic model is part of the print out from the baseline 
reduction. Assuming proper field procedures, if the network adjustment fails 
to pass the / 2 test, there is little one can do to modify the model. In fact, if 
field procedures are consistent, scaling the entire stochastic model might be 
the only option. While this procedure may result in a “passed” / 2 test, it will 

2 Readers are encouraged to rerun the data in Example 16.2 with the a priori standard deviations 
reduced by a factor of one-half to compare the adjustment results. 
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not change the coordinates in the solution since weights are relative. In fact, it 
will only change the a posteriori statistics. Thus, scaling the entire stochastic 
model by a single factor is only important if the statistics are important. Since 
this is seldom true, there is little value in scaling the stochastic model. 

If the commercial software employed the multipoint solution technique, 
better baseline vector adjustments could be obtained. This solution takes the 
individual pseudoranges from the satellites to compute baseline vectors and 
the unknown coordinates of the network stations simultaneously. Current soft¬ 
ware offerings compute the baseline vectors from the pseudoranges and then 
the coordinates of the stations from these computed vectors. This is a two-step 
process. The multipoint solution is similar to the three-dimensional geode¬ 
tic network and the photogrammetric block-bundle adjustment in that all 
unknowns are computed in one adjustment. However, it is important to remove 
any large blunders before attempting a multipoint solution. Thus, the two-step 
solution process must be maintained to ferret out problems in the data. Since 
the main advantage of the multipoint solution lies in the development of the 
stochastic model, only a few examples of this solution technique exist. 


25.4 COMPARISON OF GNSS RESIDUAL PLOTS 

Massive quantities of data are collected and reduced during the reduction of 
carrier-phase observations typically. Some software manufacturers plot pseu¬ 
dorange residuals against a time line. Examples of this are shown in Figure 25.5 
where plot (a) is for satellite vehicle 24 (SV 24) and ( b) is for satellite vehicle 
28 (SV 28). Notice that the residuals in Figure 25.5 (b) have a slight downward 
slope at the beginning of the session. In fact, except for the first three minutes, 
the residuals are fairly uniform even though most are negative in sign. During 
the first three minutes of the session, satellite 28 was just clearing the set mask 
angle and suffered some loss of lock problems. This skewed the data. 

The first three minutes of data from this satellite could be removed and the 
baseline reprocessed to correct this problem. However, this might not be prac¬ 
tical given the shortness of the overall observation session. Since much held 
time is lost to travel, setup, and tear down, it is always wise to collect more 
data than is needed to resolve the position of a GNSS receiver. This is similar 
to observing distances and angles more than once. 

Note that the residuals in Figure 25.5 (a) are mostly positive. This could have 
several causes including loss of lock problems. However, these types of plots 
are typically seen when the broadcast ephemeris is used in the reduction. The 
broadcast ephemeris is a near-future prediction of the location of the satel¬ 
lite. For various reasons, satellites sometimes stray from their predicted paths. 
When this happens, the coordinates for the satellite’s position at the time of 
broadcast are in error. It is also possible that the integer ambiguity for this 
particular satellite’s pseudorange was in error. These problems result in plots 
like Figure 25.5(a), where most of the residuals have one sign indicating a 
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FIGURE 25.5 Pseudorange residuals plots from satellites 24 (a) and 28 ( b ). 

skewed set of data. Broadcast ephemeris errors can sometimes be corrected by 
downloading and processing with a precise ephemeris. Ambiguity resolution 
problems after the data collection is complete can only be corrected by remov¬ 
ing the satellite from the data set. In general the best solutions can always be 
obtained with a precise ephemeris. Since the ultra-rapid ephemeris is available 
within a few hours of data collection, it is wise to wait for this ephemeris before 
processing the data. 

Figure 25.5 also depicts a problem with real-time kinematic (RTK) GNSS 
surveys. That is, by their very nature, the broadcast ephemeris must be used 
in processing the data. Thus, the option of downloading a precise ephemeris 
is not available. RTK surveys have their place in stakeout and mapping 
surveys. However, they should never be used to establish anything other than 
low-order control. The RTK survey is the equivalent of a radial total station 
survey leaving only minimal checks in the quality of the data. Since all GNSS 
surveys can be seriously affected by solar activity, ephemeral errors, and 
multipathing, the RTK survey leaves the surveyor open to poor results without 
any indication at the receiver. Checks on these surveys can be obtained only 
by reobserving the stations using a different satellite geometry. 
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25.5 USE OF STATISTICAL BLUNDER DETECTION 

When more than one blunder exists in a given set of data, statistical 
blunder detection methods presented in Chapter 21 help isolate the offending 
observations. These methods along with graphical techniques were presented 
in that chapter. 

The problem of having multiple blunders usually exists in large control 
surveys. When adjusting large sets of data, it is wise to break the data into 
smaller subsets that can be checked for blunders before attempting the larger 
adjustment. By breaking a larger adjustment into smaller subsets, problems 
can often be isolated, corrected, or removed from the observations. 

GNSS surveys provide similar examples. When performing a large baseline 
vector adjustment, it is often wise to download and process the data by session 
initially and then by day. Since a GNSS campaign typically involves several 
observational sessions and possibly several days of data, trying to combine all 
sessions into one large adjustment generally takes more time than individually 
processing the data by session and then day. By processing baseline vector 
data by session and then day, it becomes easier to isolate weaker and trivial 
baselines. After processing each day’s sessions satisfactorily, a combined 
network adjustment can be attempted and analyzed for blunders. It may 
be important at this point to reanalyze and possibly reprocess baselines to 
obtain the best solution. Again, statistical blunder detection will help analyze 
possible blunders in baselines. If the observation sessions are long enough, 
it is possible to eliminate data from the session to remove possible problems 
caused by obstructions and loss of lock problems. This, again, indicates the 
need to collect more data than are required to obtain a solution. A few extra 
minutes used to observe additional data can often result in improved solutions 
without returning to the held to reobserve a baseline. 

PROBLEMS 

Note: Partial answers to problems marked with an asterisk can be found in 
Appendix H. 

25.1 Following an adjustment, how is the term large defined in relation to 
residuals? 

25.2 What are the basic concepts of a normal distribution, and how 
are these concepts used to analyze the results of a least squares 
adjustment? 

*25.3 An adjustment has 22 observations. Only 10 of these residuals are 
negative in sign. Should this cause concern during the analysis? 

25.4 Discuss why the goodness of ht test is not always a reliable indicator 
of a blunder in data. 
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25.5 What does it mean to “fail” the / 2 test? 

25.6 Discuss possible methods that can be used to develop a proper 
stochastic model in a horizontal network survey. 

25.7 Discuss why the scaling of the stochastic model does not affect the 
adjusted parameters. 

25.8 What is a possible reason for the residual plot in Figure 25.5(a)? 

25.9 Discuss the importance of collecting more than the minimum amount 
of data in a GNSS survey. 

25.10 Why should the RTK survey method not be used to establish 
high-order control stations coordinates? 

25.11 Why should baseline vectors be processed by session rather than 
byjob? 

*25.12 A baseline vector determined by rapid-static method (3 mm + 
0.5 ppm) has a length of about 4.5 km. The instrument setups 
were estimated to be within ±3 mm of the true station location. Its 
combined XYZ residual is 2.5 cm. At a 99% confidence level, should 
this residual be considered too large if the number of redundant 
observations in the adjustment is 15? 

25.13 Similar to Problem 25.12, except the length of the baseline vector is 
6 km and the size of the XYZ residual is 2.2 cm. At a 99% confidence 
level, should this residual be considered too large if the number of 
redundant observations in the adjustment is 15? 

*25.14 A distance in a horizontal network survey with 1 6 degrees of freedom 
has a residual of -0.14 ft. Its a priori estimated error is ±0.034 ft. 
At a 99% level of confidence, is this residual too large? 

25.15 A distance in a horizontal network survey with 14 degrees of freedom 
has a residual of -0.10 ft. Its a priori estimated error is ±0.024 ft. 
At a 99% level of confidence, is this residual too large? 

In Problems 25.16 through 25.28, analyze the residuals from the least squares 
adjustment using ADJUST. Indicate if there are any areas of concern in the 
data or stochastic model. When possible, isolate and remove questionable data 
and stochastic models at a 99% level of confidence. After the changes, rerun 
the adjustment and compare the results. {Note: Not all of the problems have 
questionable data.) 

25.16 Problem 12.13. 

25.17 Problem 12.14. 

25.18 Problem 12.15. 
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25.19 Problem 15.10. 

25.20 Problem 15.12. 

25.21 Problem 15.15. 

25.22 Problem 16.8. 

25.23 Problem 16.14. 

25.24 Problem 16.15. 

25.25 Assuming a rapid static survey method was used with a manufac¬ 
turer’s stated accuracy of (3.0 mm + 0.5 ppm), and the setup errors 
were estimated to be ±3 mm at each setup, analyze the data in 
Problem 17.5 at a 99% level of confidence. 

25.26 Assuming a rapid static survey method was used with a manufac¬ 
turer’s stated accuracy of (5.0 mm + 1 ppm), and the setup errors were 
estimated to be ±3 mm at each setup, analyze the data in Problem 17.7 
at a 99% level of confidence. 


CHAPTER 26 


COMPUTER OPTIMIZATION 


26.1 INTRODUCTION 

Large amounts of computer time and storage requirements can be used when 
performing least squares adjustments. This is due to the fact that as the 
problems become more complex, the matrices become larger, and the storage 
requirements and time consumed in doing numerical operations grow rapidly. 
As an example, in analyzing the storage requirements of a 25-station horizon¬ 
tal least squares adjustment that has 50 distance and 50 angle observations, 
the coefficient matrix would have dimensions of 100 rows and 50 columns. 
If this adjustment were done in double precision, 1 it would require 40,000 bytes 
of storage for the coefficient matrix alone. The weight matrix would require an 
additional 80,000 bytes of storage. Also, at least two additional similarly sized 
intermediate matrices 2 must be formed in computing the solution. From this 
example, it is easy to see that large quantities of computer time and computer 
memory can be required in least squares adjustments. Thus, when writing 
least squares software, it is desirable to take advantage of some storage and 
computing optimization techniques. In this chapter, some of these techniques 
are described. 

1 The storage requirement of a double-precision number is eight bytes. 

2 The intermediate matrices developed are A T and A T W or / T and J T W, depending on whether the 
adjustment is linear or nonlinear. 
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26.2 STORAGE OPTIMIZATION 

Many matrices used in a surveying adjustment are large but sparse. Using the 
example above, a single row of the coefficient matrix for a distance observation 
would require a 50-element row for its four nonzero elements. In fact, the entire 
coefficient matrix is sparsely populated by nonzero values. Similarly, the nor¬ 
mal matrix is always symmetric, and thus nearly half its storage is used by 
duplicate entries. It is relatively easy to take advantage of these conditions to 
reduce the storage requirements. 

For the normal matrix, only its upper- or lower-triangular portion of the 
matrix need be saved. In this storage scheme, the two-dimensional matrix is 
saved as a vector. An example of a 4 x 4 normal matrix is shown in Figure 26.1. 
Its upper- and lower-triangular components are shown separated and their ele¬ 
ments numbered for reference. The vector on the right of Figure 26.1 shows the 
storage scheme. This scheme eliminates the need to save the duplicate entries of 
the normal matrix, but requires some form of relational mapping between the 
original matrix indices of row i and column j and the vector’s index of row i. 
For the upper triangular portion of the matrix, it can be shown that the vector 
index for any (/, /) element is computed as 

Index(z'j) = i [./(./ - 1)] + i (26.1) 

Using the function given in Equation (26.1), the vector index for element 
(2, 3) of the normal matrix would be computed as 

Index (2, 3) = i [3(3 - 1)] + 2 = 5 

An equivalent mapping formula for the lower-triangular portion of the 
matrix is given as 

Index (ij) = i [/(/ - 1)] + j (26.2) 

Equation (26.1) or (26.2) can be used to compute the storage location for 
each element in the upper or lower part of the normal matrix, respectively. 
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FIGURE 26.1 Structure of the normal matrix. 
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Of course, it requires additional computational time to map the location of 
each element every time it is used. One method of minimizing computing time 
is to utilize a mapping table. The mapping table is a vector of integers that 
identifies the storage location for only the initial element of a row or column. 
To reduce total computational time, the indices are stored as one number less 
than their actual value. For the example matrix stored in Figure 26.1, it would 
have a relational mapping table of 

VI T = [0 1 3 6 10] 

Although the storage location of the first element is 1, it can be seen above 
that it is identified as 0. Similarly, every other mapping index is one number less 
than its actual location in the vector, as shown in Figure 26.1. The mapping 
vector is found using the pseudocode shown in Table 26.1. 

By using this type of mapping table, the storage location for the first element 
of any upper-triangular column is computed as 

Indexf/,/) = VI(/) + i (26.3) 

Using the mapping table, the storage location for the (2, 3) element is 
Index(2,3) = VI(3) + 2 = 3 + 2 = 5 

The equivalent formula for the lower triangular portion is 

Index(/,y) = VI(z) + j (26.4) 

Obviously, this method of indexing an element’s position requires addi¬ 
tional storage in a mapping table, but the additional storage is offset by the 
decreased computational time that is created by multiplication operations 
in Equations (26.1) and (26.2). Although every compiler and machine are 
different, a set of times to compare indexing methods are shown in Table 26.2. 
The best times were achieved by minimizing both the number of opera¬ 
tions and calls to the mapping function. Thus, in method C, the mapping 
table was created to be a global variable in the program and the table was 
accessed directly as needed. For comparison, the time to access the matrix 
elements directly using the loop shown in method D was 1.204 seconds. Thus, 
method C uses only slightly more time than method D but helps avoid the 
additional memory that is required by the full matrix required for method 
D. Meanwhile, method A is slower than method C by a factor of 3. Since the 
matrix elements must be accessed repeatedly during a least squares solution, 
this difference can be a significant addition to the total solution time. 

The additional overhead cost of having the mapping table is minimized by 
declaring it as an integer array so that each element requires only two bytes 

TABLE 26.1 Creation of a Mapping Table 


VI(1) = 0 

For i going from 2 to the number of unknowns: Vl(z') = VI(z — 1) + i — 1 
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TABLE 26.2 Comparison of Indexing Methods 


Time Extra 
Method (sec) Storage 


Method A : Using function A 
i from 1 to 1000 

j from i to 1000 

k = Index( i,j ) 


A 4.932 0 

B 3.937 2 bytes per element 

C 1.638 2 bytes per element 

D 1.204 Full matrix 

Function A: Index = j(j - l)/2 + i 
Function B: Index = VI( j) + i; 


Method B: Using function B 
i from 1 to 1000 

j from i to 1000 

k = Index( i,j ) 


Method C: Direct access to mapping table 
i from 1 to 1000 

j from i to 1000 
k = VI(j) + I 


Method D: Direct matrix element access, 
i from 1 to 1000 

j from 1 to 1000 
k = A [i , j] 


of storage. In the earlier example of 25 stations, this results in 100 bytes of 
additional storage for the mapping table. Speed versus storage is a decision 
that every programmer will continually face. 

26.3 DIRECT FORMATION OF THE NORMAL EQUATIONS 

The basic weighted observation equation form is WAX — WL + WV. 
The least squares solution for this equation is X= ( A T WA)~ 1 (A T WL ) = N~ l C, 
where A T WA is the normal equations matrix N, and A r WL is the constants 
matrix C. If the weight matrix is diagonal, formation of the A, W, L, and 
A J W matrices is unnecessary when building the normal equations and the 
storage requirements for them can be eliminated. This is accomplished by 
forming the normal matrix directly from the observations. The tabular method 
in Section 11.8 showed the feasibility of this method. Notice in Table 11.2 
that the contribution of each observation to the normal matrix is computed 
individually and, subsequently, added. This shows that there is no need to 
form the coefficient, constants, weight, or any intermediate matrices when 
deriving the normal matrix. Conceptually, this is developed as follows: 

Step 1: Zero the normal and constants matrix. 

Step 2: Zero a single row of the coefficient matrix. 

Step 3: Based on the values of a single row of the coefficient matrix, add the 
proper value to the appropriate normal and constant elements. 

Step 4: Repeat steps 3 and 4 for all observations. 

This procedure works in all situations that involve a diagonal weight 
matrix. Procedural modifications can be developed for weight matrices with 
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TABLE 26.3 Algorithms for Building the Normal Equations Directly from Their 
Observations 


BASIC Language 

FORTRAN Language 

For i = 1 to unknown 

ix = VI(i): ixi = ix + i 

N(ixi) = N(ixi) + A(i) A 2 * W(i) 

C(i) = C(i) + A(i)*W(i)*L(i) 

For j = i+1 to unknown 

N(ix+j) = NCix+j) + A(i)*W(i)*A(j) 
Next j 

Next I 

Do 100 i = 1, unknown 
ix = VI (i) 
ixi = ix + i 

N(ixi) = N(ixi) + A(i)**2 * W(i) 

C(i) = C(i) + A(i)*W(i)*L(i) 

Do 100 j = i+1, unknown 

NCix+j) = N(ix+j) + A(i)*W(i)*A(j) 

100 Continue 

C Language 

Pascal Language 

for ( i=l; i<=unknown; i++) { 
ix = VI[i]; ixi = ix + i; 
n[ixi] = n[ixi] + a[i]*a[i] * w[i]; 
c [i ] = c[i] + a[i]*w[i]*l[i]; 
for ( j=i+l; j<=unknown; j++) 

n[ix+j] = n[ix+j] + a[i]*w[i]*a[j]; 
}// for i 

For i := 1 to unknown do begin 
ix := VI[i]; ixi := ix + i; 

N[ixi] := N[ixi] + Sqr(A[i]) * W[i]; 

C[i] := C[i] + A[i]*W[i]*L[i]; 

For j := i+1 to unknown do 

N[ix+j] := N[ix+j] + A[i]*W[i]*A[j] 

End; { for i } 


limited correlation between the observations. Computer algorithms in BASIC, 
FORTRAN, C, and Pascal for this method are shown in Table 26.3. 


26.4 CHOLESKY DECOMPOSITION 

Flaving formed only a triangular portion of the normal matrix, a Cholesky 
decomposition can be used to greatly reduce the time needed to find the solu¬ 
tion. This procedure takes advantage of the fact that the normal matrix is 
always a positive-definite matrix. 3 Due to this property, it can be expressed 
as the product of a lower-triangular matrix and its transpose; that is, 

N = LU = LL t = U T U 

where L is a lower triangular matrix of the form 
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3 A positive-definite square matrix. A, has the property that X T AX> 0 for all nonzero vectors, X. 
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When the normal matrix is stored as a lower-triangular matrix, it can be 
factored using the following procedure: 

for i = 1 , 2 ,..., number of unknowns compute 



(26.5) 


for j = i + 1, / + 2,..., number of unknowns compute 


z-l 

/ _ v / / 

7 i ij L jk 

k= 1 


The procedures above are shown in code-form in Table 26.4. 


TABLE 26.4 Computer Algorithms for Computing Cholesky Factors of a Normal 
Matrix 


BASIC Language 

FOR i = 1 TO unknown 

ix = VI(i): ixi = ix + i: s = 0# 

FOR k = 1 TO i - 1 

s = s + N(ix + k) A 2: NEXT k 
N(ixi) = SQR(N(ixi) - s) 

FOR j = i + 1 TO unknown 
s = 0#: jx = VI(j) 

FOR k = 1 TO i - 1 

s = s + N(jx + k) * N(ix + k): NEXT k 
N(jx + i) = (N(jx + i) - s) / N(ixi) 
NEXT j 
NEXT i 


C Language 

for ( i=l; i<=unknown; i++ ) { 
ix = VI[i]; ixi = ix+i; s = 0.0; 
for ( k=l; k<i; k++ ) 

s = s + n[ix+k]*n[ix+k]; 
n[ixi] = sqrt( n[ixi] - s ); 
for ( j=i+l; j<=unknown; j++ ) { 
s = 0; jx = VI[j]; 
for ( k=l; k<i; k++) 

s = s + n[jx+k] * n[ix+k]; 
n[jx+i] = ( n[jx+i] - s ) / n[ixi] ; 
} // for j 
} // for i 


FORTRAN Language 

Do 30 i = 1,Unknown 
ix = VI (i) 
il = i - 1 
S = 0.0 

Do 10 k=l, il 
10 s = s + N( ix+k )**2 
N(ix+i) = Sqrt( N(ix+i)-s ) 

Do 30 j = i+1, Unknown 
s = 0.0 

Do 20 k = 1, il 

20 s = s + N(VI[j]+k)*N( ix+k ) 
N(VI[j]+i) = 

(N(VI[j]+i) -s) / N(ix+i) 

30 Continue 

Pascal Language 

For i := 1 to unknown do Begin 

ix : = VI[i] ; ixi := ix+i; S := 0; 

For k := 1 to Pred( i ) do 
S := S + Sqr( N[ix+k] ); 

N[ixi] := Sqrt( N [i xi ] -S ); 

For j := Succ(i) to unknown do Begin 
S := 0; jx := VI[j]; 

For k := 1 to Pred(i) do 

S := S + N[jx+k]*N[ix+k] ; 

N[jx+i] := ( N[jx+i] - S ) / N[ixi] 
End; { for j} 

End; { for i } 
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26.5 FORWARD AND BACK SOLUTIONS 


Being able to factor the normal matrix into triangular matrices has the advan¬ 
tage that the matrix solution can be obtained without the use of an inverse. 
The equivalent triangular matrices representing the normal equations are 


( A t WA)X - NX - LUX = ll7x 
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(26.6) 


Equation (26.6) can be rewritten as LY = C, where L r X = Y. From this, 
the solution for Y can be found by taking advantage of the triangular form 
of L. This is known as a forward substitution. Steps involved in forward 
substitution are 


Step 1: Solve for;q as y 1 = c l /l n . 

Step 2: Substitute this value into row 2, and compute y 2 as y 2 = 
c 2 ~ hiYi/ln- 

Step 3: Repeat this procedure until all values for y are found using the 

i -1 

algorithm y, = c ( - £ l ik y k lhi- 

k= 1 

Having determined Y, the solution for the matrix system L J X = Y is com¬ 
puted in a manner similar to that above. However, this time the solution starts at 
the lower-right corner and proceeds up the matrix L 1 . This is called a backward 
substitution, which is done with the following steps: 

Step 1: Compute x n as x n = y n /l nn . 

Step 2: Solve for x n _ x as x n _ x = y n _ x - l m xj / (n _i X «-i)- 

Step 3: Repeat this procedure until all unknowns are computed using the 

n 

algorithm x k = y k - £ Vy/4/t- 

]=k +1 

In this process, once the original values in the constant matrix are accessed 
and changed, they are not needed again, and the original C matrix can be 
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TABLE 26.5 Computer Algorithms for Forward and Back Substitutions 


BASIC Language 

Rem Forward Substitution 
For i = 1 to Unknown 
ix = VI (i) 

C(i) = C(i) / N(ix+i) 

For j = i+1 to Unknown 

C(j) = C(j) - NCix+j) * C(i) 
Next j 
Next i 

Rem Backward Substitution 
For i = Unknown to 1 Step -1 
ix = VI (i) 

For j = Unknown To i+1 Step -1 
C(i) = N(ix+j) * C(j) 

Next j 

C(i) = C(i) / N(ix+i) 

Next i 


FORTRAN Language 

C Forward Substitution 
Do 100 i = 1,Unknown 
ix = VI (i) 

C(i) = C(i) / N(ix+i) 

Do 100 j = i+1, Unknown 

C(j) = C(j) - NCix+j) * C(i) 
100 Continue 
C Backward Substitution 

Do 110 i = Unknown, 1,-1 
ix = VI (i) 

Do 120 j = Unknown, i+1, -1 
120 C(i) = C(i) - N(Ix+j) * C(j) 
CCi) = C(i) / NCIx+i) 

110 Continue 


C Language 

//Forward Substitution 
for Ci=1; i<=unknown; i++){ 
ix = VI[i]; 
c[i] = c[i]/n[ix+i]; 
for (j=i+l; j<=unknown; j++){ 
c[j] = c[j] - n[ix+j]*c[i]; 

} //for j 
} //for i 

//backward substitution 
for (i=unknown; i>=l; i—){ 
ix = VI[i]; 

for (j=unknown; j>=i+l; j—){ 
c[i] = c[i] - n[ix+j] * c[j]; 
} //for j 

c[i] = c[i]/n[ix+i]; 

} // for i 


Pascal Language 

{Forward Substitution} 

For i := 1 to Unknown Do Begin 
ix := VI [i]; 

C[i] := C[i] / N[ix+i] ; 

For j := i+1 to Unknown Do 

C[j] C[j] - N[ix+j] * C[i]; 
End; { for i } 

{Backward Substitution} 

For i := Unknown DownTo 1 do Begin 
ix := VI [i] ; 

For j := Unknown DownTo i+1 Do 
C[i] := C[i] - N[Ix+ j] * C[j] ; 
C[i] : = C[i] / N[Ix+i] ; 

End; { for i } 


overwritten with Y and X matrices so that the entire process requires no 
additional storage. In fact, this method of solution also requires fewer opera¬ 
tions than solving X = (A J WA)~ l A r WL directly. Table 26.5 lists the computer 
codes for these algorithms. 


26.6 USING THE CHOLESKY FACTOR TO FIND THE INVERSE 
OF THE NORMAL MATRIX 

If necessary, the original normal matrix inverse can be found with the Cholesky 
factor. To derive this matrix, the inverse of the Cholesky factor is com¬ 
puted. The normal matrix inverse is the product of this inverse times its 
transpose. The Cholesky factor inverse is determined using the algorithm in 
Table 26.6. Code for this algorithm is shown in Table 26.7. 
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TABLE 26.6 Pseudocode for Algorithm Computing the Inverse of a Cholesky 
Decomposed Matrix 


for 7 going from the number of unknowns down to 1 

for k going from number of unknowns down to i + 1 

for j going from 7+1 to k, sum the product N(i, j) * A/(j, k) 
A/C 7, k) = -S / A/C 7 » 7) 

A/C 7*, 7) = 1/A/C 7, O 


TABLE 26.7 Computer Algorithms to Find the Inverse of a Cholesky Factored 
Matrix 


BASIC Language 
{Inverse} 

For i = Unknown To 1 Step -1 
ix = VI (i): ixi = ix + i 
For k = Unknown To i+1 Step -1 
S = 0! 

For j = i+1 To k 

S = S + N(ix+j) * N(VI(j)+k) 
Next j 

N(ix+k) = -S / N(ixi) 

Next k 

N(ixi) = 1.0 / N(ixi) 

Next i 

{Inverse * Transpose of Inverse} 

For j = 1 to Unknown 
ixj = VI(j) 

For k = j to Unknown 
S = 0! 

For i = k to Unknown 

S = S + N(VI(k)+i) * NCixj+i) 
Next i 

N(ixj+k) = S 
Next k 
Next j 

C Language 
{Inverse} 

for ( i=unknown; i>=l; i—) { 
ix = VI[i]; ixi = ix + i; 
for( k=unknown; k>=i+l; k—) { 

S = 0.0; 

for ( j=i+l; j<=k; j++) 

S = S + N[ix+j] * N[VI[j]+k]; 
N[ix+k] = -S / N [i xi ]; 

} // for k 

N [i xi ] = 1.0 / N [i xi ]; 

} // for i 

{inverse * transpose of inverse} 
for C3=1; j<=unknown; j++) { 
ixj = VI[j]; 

for (k=j; k<=unknown; k++) { 

S = 0.0; 

For (i=k; i<=unknown; i++) 

S = S + N[VI[k]+i] * N[ixj+i]; 
N[ixj+k] = S 
} // for k 
} //for j 


Fortran Language 

C Inverse 

Do 10 i = Unknown, 1,-1 
ix = VI (i) 
ixi = ix + i 

Do 11 k = Unknown, i+1,-1 
S = 0.0 

Do 12 j = i+l,k 

12 S = S + N(ix+j) * N(VI(j)+k) 
N(ix+k) = -S / N(ixi) 

11 Continue 

N(ixi) = 1.0 / N(ixi) 

10 Continue 

C Inverse * Transpose of Inverse} 

Do 20 j = 1, Unknown 
ixj = VI(j) 

Do 21 k = j, Unknown 
S = 0.0 

Do 22 i = k,Unknown 
22 S = S + N(VI(k)+i) * N(ixj+i) 
N(ixj+k) = S 
21 Continue 
20 Continue 

Pascal Language 
{Inverse} 

For i := Unknown DownTo 1 do Begin 
ix : = VI [i ]; ixi := ix + i; 

For k := Unknown DownTo i+1 Do Begin 
S := 0.0; 

For j := i+1 To k Do 

S := S + N[ix+j] * N[VI[j] +k]; 
N[ix+k] := -S / N[ixi] ; 

End; { For k } 

N[ixi] := 1.0 / N[ixi]; 

End; { For i } 

{Inverse * Transpose of Inverse} 

For j := 1 to Unknown Do Begin 
ixj := VI[j]; 

For k := j to Unknown Do Begin 
S := 0.0; 

For i := k to Unknown Do 

S := S + N[VI [k] +i] * N[ixj+i]; 
N[ixj+k] := S 
End; { For k } 

End; { For j } 
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26.7 SPARENESS AND OPTIMIZATION OF THE NORMAL MATRIX 

In the least squares adjustment of most surveying and photogrammetry 
problems, it is known that certain locations in the normal matrix will contain 
zeros. The network shown in Figure 26.2 can be used to demonstrate this 
fact. In that figure, assume that distances and angles were observed for every 
line and arc, respectively. The following observations are made about the 
network’s connectivity. Station 1 is connected to stations 2 and 8 by distance 
observations and is also connected to stations 2, 3, and 8 by angles. Notice that 
its connection to station 3 is due to angles turned at both 2 and 8. Since these 
angles directly connect stations 1 and 2, it follows that if the coordinates of 
3 change, so will the coordinates of 1, and thus with respect to station 1, the 
normal matrix can be expected to have nonzero elements corresponding to 
the stations 1, 2, 3, and 8. Conversely, the positions corresponding to stations 
4, 5, 6, and 7 will have zeros. 

Using this analysis with station 3, because it is connected to stations 1, 2, 
4, 7, and 8 by angles, zero elements can be expected in the normal matrix cor¬ 
responding to stations 5 and 6. This analysis can be made for each station. 
The resulting symbolic normal matrix representation is shown in Figure 26.3. 


2 3 4 5 



1 8 7 6 


FIGURE 26.2 Horizontal network. 
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FIGURE 26.3 Normal matrix. 
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A process known as reordering the unknowns can minimize both storage and 
computational time. Examine the matrix shown in Figure 26.4 that results from 
placing the unknowns of Figure 26.3 in the order of 6, 5, 4, 7, 3, 1, 2, and 8. 
This new matrix has its nonzero elements immediately adjacent to the diagonal 
elements, and thus the known zero elements are grouped together and appear in 
the leftmost columns of their respective matrix rows. By modifying the mapping 
table, storing the known zero elements of the original matrix in Figure 26.3 can 
be avoided, as is shown in the column matrix of Figure 26.4. 

This storage scheme requires a mapping table that provides the storage loca¬ 
tion for the first nonzero element of each row. Since the diagonal elements 
are always nonzero, they can be stored in a separate column matrix without 
loss of efficiency. Ignoring the fact that each station has two unknowns, the 
mapping of the first element for each row is 1, 1, 2, 4, 7, 9, 10, 12, and 17. 
This mapping scheme enables finding the starting position for each row and 
allows for the determination of the off-diagonal length of the row. That is, row 
1 starts at position 1 of the column matrix, but has a length of zero (1 - 1), 
indicating that there are no off-diagonal elements in this row. Row 2 starts at 
position 1 of the column matrix and has a length of (2 - 1) = 1. Row 5 starts at 7 
and has a length of (9 - 7) = 2. By optimizing for matrix sparseness and symme¬ 
try, only 24, (16 + 8), elements of the original 64-element matrix need be stored. 

This storage savings, when exploited, can also result in a savings of compu¬ 
tational time. To understand this, first examine how the Cholesky factorization 
procedure processes the normal matrix. For a lower triangular matrix factor¬ 
ization process, Figure 26.5 shows the manner in which elements are accessed. 
Notice when a particular column is modified, the elements to the left of this 
column are used. Also notice that no rows above the corresponding diagonal 
element are used. 
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FIGURE 26.4 Reordered normal matrix. 
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not accessed 
computed and accessed 
currently accessed 
yet to be accessed 


FIGURE 26.5 Computation of the Cholesky factor. 

To see how the reorganized sparse matrix can be exploited in the fac¬ 
torization process, the processing steps must be understood. In Figure 26.4 
the first two elements of row 5 are known zeros, and each summation loop 
in the factorization process should start with the third column. If the zeros in 
the off-diagonals are rearranged such that they occur in the leftmost columns 
of the rows, it is possible to avoid that portion of the operations for the rows. 
Notice how the rows near the lower portion of the matrix are optimized 
to minimize the computational effort. A savings of eight multiplications is 
obtained for computations of column 5. In a large system, the cost savings 
of this optimization technique can be enormous. A complete discussion of 
these techniques is presented by George and Lui (1981). A comparison of 
the operations performed when computing column 5 in Figure 26.4 using 
a Cholesky decomposition of both a full and optimized solution routine 
are shown in Table 26.8. Note that computations for rows 6 and 7 do not 
exist since these rows had known zeros in the columns before column 5 after 
the reordering process. If only the more time-consuming multiplication and 
division operations are counted, the optimized solution requires 5 operations 
as compared to 19 in the nonoptimized (full) solution. 



TABLE 26.8 Comparison of Number of Operations in Computing One Column 



Full Operations 


Optimized Operations 

1 

S = n 51 + n 52 + ' ■ ■ + n 54 


S = n 53 + n 54 

2 

n 55 = square root of ( n 55 — s ) 


n 55 = square root of ( n 55 - s ) 

3 

j = 6 


j = 6 


(a) s = n 61 * n 51 + n 62 * n 52 + • ■ 

' • + n 64 * n 54 

no operations necessary 


(b) n 65 = (n 65 - s)/n 55 


j = 7 


j = 7 


no operations necessary 


(a) s = n 71 * n 51 + n 72 * n 52 + • ■ 

' • + n 74 * n 54 

j = 8 


(b) n 75 = (n 75 - s)/n 55 


s = n 83 * n 53 + n 84 * n 54 


j = 8 




(a) s = n 81 * n 51 + n 82 * n 52 + • ■ 

■ • + n 84 * n 54 



(b) n 85 = (n 85 - s)/n 55 
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TABLE 26.9 Connectivity Matrix 


Station 

Connectivity 

Degree 

6 

5 

4 

7 

3 

1 

2 

1 

2,3,8 

3 

3 

3 

3 

3 

2 

— 

— 

2 

1,3,8 

3 

3 

3 

3 

3 

2 

1 

- 

3 

1,2,4,7,8 

5 

5 

5 

4 

3 

- 

- 

- 

4 

3,5,6,7,8 

5 

4 

3 

- 

- 

- 

- 

- 

5 

4,6,7 

3 

2 

- 

- 

- 

- 

- 

- 

6 

4,5,7 

3 

- 

- 

- 

- 

- 

- 

- 

7 

3,4,5,6,8 

5 

4 

3 

2 

- 

- 

- 

- 

8 
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5 

5 

5 

4 

3 

2 

1 

0 


Several methods have been developed to optimize the ordering of the 
unknowns. Two of the more well-known reordering schemes are the reverse 
Cutliill-Mckee and the Snay’s banker’s algorithm. Both of these algorithms 
reorder stations based on their connectivity. The example of Figure 26.2 will 
be used to demonstrate the banker’s algorithm. In this example, a connectivity 
matrix is first developed. This is simply a list of stations that are connected to a 
given station by either an angle or distance observations. For instance, station 
1 is connected to stations 2 and 8 by distances, and additionally to station 3 
by angles. The complete connectivity matrix of Figure 26.2 is listed in the first 
two columns of Table 26.9. In addition to the connectivity, the algorithms also 
need to know the number of connected points for each station. This is known 
as the stations degree. 

To start the reordering, select the station with the lowest degree. In this 
example, that could be either station 1,2, 5, or 6. For demonstration pur¬ 
poses, begin with station 6. This station is now removed from each station’s 
connectivity matrix, and thus stations 4, 5, and 7 have their degrees reduced by 
one. This is shown in column 6. Now select the next station with the smallest 
degree. Since station 5 had its degree reduced to 2 when station 6 was selected, 
it now has the smallest degree. This process is continued, that is, the next sta¬ 
tion with the smallest degree is selected and is removed from the connectivity 
of the remaining stations. If two or more stations have the smallest degree, 
the most recently changed station with the smallest degree is chosen. In this 
example, this happened after choosing station 5. Station 4 was selected over 
stations 1 and 2 simply because it just had its degree reduced. Although station 
7 qualified equally to station 4, station 4 was higher on the list and was selected 
for that reason alone. This happened again after selecting station 7. Station 3 
was the next choice since it was the first station reduced to a degree of 3. Note 
that the final selection of station 8 was omitted from the list. 

A similar optimized reordering can be found by starting with station 1, 2, 
or 5. This is left as an exercise. For a computer algorithm of this reordering the 
reader should refer to the NOAA Technical Memorandum NGS 4 by Richard 
Snay; the computer algorithm for the reverse Cuthill-McKee is given in the 
book by George and Lui (see the Bibliography). 
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PROBLEMS 

26.1 Explain why computer optimization techniques are necessary for doing 
large least squares adjustments. 

26.2 When using double precision, how much computer memory is required 
in forming the /, W, K, J j , J T W, ./' WK, and J 1 W.I matrices for a 
20-station adjustment having 50 total observations? 

26.3 If the normal matrix of Problem 26.2 were stored in lower triangular 
form and computed directly from the observations, how much storage 
would be required? 

26.4 Discuss how computational savings are created when solving the normal 
equations by Cholesky factorization and substitution. 

26.5 Write a comparison of an operations table similar to that in Table 26.8 
for column 3 of the matrix shown in Figure 26.4. 

26.6 Same question as Problem 26.5 except with column 6. 

26.7 Using the station reordering algorithm presented in Section 26.7, 
develop a connectivity matrix and reorder the stations when starting 
with station 1. Draw the normal matrix of the newly reordered station’s 
which is similar to the sketch shown in Figure 26.4. 

26.8 Same as Problem 26.7 except start the reordering with station 2. 

26.9 Same as Problem 26.7 except start the reordering with station 5. 


PROGRAMMING PROBLEMS 

26.10 Develop a least squares program similar to those developed in Chapter 
16 that builds the normal equations directly from the observations and 
uses a Cholesky factorization procedure to find the solution. 

26.11 Develop a Mathcad® worksheet that solves Problem 26.10. 


APPENDIX A 


INTRODUCTION TO MATRICES 


A.1 INTRODUCTION 

Matrix algebra provides at least two important advantages: (1) it enables 
reducing complicated systems of equations to simple expressions that can 
be visualized and manipulated more easily, and (2) it provides a systematic, 
mathematical method for solving problems that is well adapted to computers. 
Problems are frequently encountered in surveying, geodesy, and photogram- 
metry that require the solution of large systems of equations. This book 
deals specifically with the analysis and adjustment of redundant observations 
that must satisfy certain geometric conditions. This frequently results in 
large equation systems, which when solved according to the least squares 
method yield most probable estimates for adjusted observations and unknown 
parameters. As will be demonstrated, matrix methods are particularly well 
suited for least squares computations, and in this book they are used for 
analyzing and solving these equation systems. 


A.2 DEFINITION OF A MATRIX 

^3 A matrix is a set of numbers or symbols arranged in a square or 
rectangular array of in rows and n columns. The arrangement is such that 
certain defined mathematical operations can be performed in a systematic 
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and efficient manner. As an example of a matrix representation, consider the 
following system of three linear equations involving three unknowns: 

a n x j + a n x 2 + $i 3 .x 3 = c l 

a 2l x \ + a 22 x 2 + $23*3 ~ c 2 (A.l) 

a 31 X! + $32*2 + $33 A; = C 3 


In Equation (A.l), a’s are the coefficients of the unknown parameters x, 
and c’s the constant terms. The system above can be represented in summation 
notation as 

3 

X a U x i = c 'l 

i= 1 

3 

X a 2i X i = c 2 

i= 1 

3 

X fl 3 i X i = C 3 
i=l 

It can also be represented in matrix form as 


$11 $12 $13 


X 1 


Cl 

$21 $22 $23 


X 2 

= 

c 2 

$31 $32 $33 


x 3 


C 3 


In turn, Equation (A.2) can be represented in compact matrix notation as 

AX = C (A.3) 

In Equation (A.3), capital letters (A, X, and Q are used to denote a matrix or 
an array of numbers or symbols. From simplified Equation (A.3), it is imme¬ 
diately obvious that matrix methods provide a compact shorthand notation 
convenient for handling large systems of equations. 


A.3 SIZE OR DIMENSIONS OF A MATRIX 


The size or dimension of a matrix is specified by its number of rows m and its 
number of columns n. Thus, the following matrix 2 O ' is a 2 x 3 matrix where 
there are two rows and three columns (i.e., m — 2,n = 3). Notice that the sub¬ 
script indicates the number of rows and the superscript indicates the number 
of columns in the notation 2 D 3 . 


d\\ 

d\2 

d\2 


'3 

2 

6 

d 2 \ 

d 22 

^23 


5 

4 

1 
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Also, the matrix E below is a 3 X 2 matrix 


3 


E 2 = 

e n 

e 2l 

e 12 

e 22 

_ 

’7 1 

4 3 


e 3l 

os 

K> 

1_ 


2 8 


Note that the position of an element in a matrix is defined by a double sub¬ 
script, and that a lowercase letter is used to designate any particular element 
within a matrix. Thus, ci 23 = 1 is in row 2 and column 3 of the above matrix D. 
In general, the subscript ij indicates an element’s position in a matrix where i 
represents the row and j the column. 


A.4 TYPES OF MATRICES 


Several different types of matrices exist as described below. Various symbols 
can be used to designate them as illustrated. 


1. Column matrix. The number of rows can be any positive integer, but the 
number of columns is one. This matrix is also known as a vector. 


A = 


3 

-2 

5 


2. Row matrix. The number of columns can be any positive integer but the 
number of rows is one. 

A=[ 6 -4 2] 

3. Rectangular matrix. The number of rows and columns are m and n, 
respectively, where m and n are any positive integers. 


A = 


3 2 6 
5 4 1 


4. Square matrix. The number of rows equals the number of columns. 


A = 


4 

-7 

6 


2 -5 

3 4 

-1 9 


A square matrix, for which the determinant is zero, is termed singular. If the 
determinant is nonzero it is termed nonsingular (the determinant of a matrix is 
discussed in Section B.3). 
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5. Symmetric matrix. The matrix is mirrored about the main diagonal going 
from top left to bottom right (i.e., element a tJ = element a A. A symmetric 
matrix is always a square matrix. 


A = 


2 

-4 

6 


-4 6 
7 3 
3 5 


6. Diagonal matrix. Only the elements on the main diagonal are not zero. 
The diagonal matrix is always a square matrix. 


A = 


7 

0 

0 


0 0 
-3 0 
0 6 


7. Unit matrix. A diagonal matrix with ones along the main diagonal. It is 
also called the identity matrix and is usually identified by the symbol I. 


1 = 


1 

0 

0 


0 

1 

0 


0 

0 

1 


8. Transpose of a matrix. It is obtained by interchanging rows and columns 
(i.e., element af. = element of. Thus, the dimensions of A T are the reverse 
of the dimensions of A. If 


A = 


2 4 
5 3 


7 

1 


the transpose of A, denoted A T is 


A t 


2 5 
4 3 
7 1 


A.5 MATRIX EQUALITY 


Two matrices are said to be equal only when they are equal element by element. 
Thus, the two matrices must be the same size or have the same dimensions. 


A = 


1 7 6 
4 3 2 


= B 
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A.6 ADDITION OR SUBTRACTION OF MATRICES 


Matrices can be added or subtracted, but to do so, they must have the 
same dimensions. If two matrices have equal dimensions, they are said to be 
conformable for addition or subtraction. In adding or subtracting matrices, 
elements from each unique row/column position of the two matrices are added 
or subtracted systematically. The sum or difference is placed in the same 
unique row/column location of the resulting matrix. The following example 
illustrates this procedure. 


2 


A 3 + 2 B 3 


7 3 
2 -5 


-1 

6 


+ 


1 5 6 

-4 -2 3 


8 8 5 

-2 -7 9 


2 c 


3 


Assuming that two matrices are conformable for addition or subtraction, 
the following are true: 


(a) A + B = B + A (commutative law) 

(b) A + [B + C) = (A + B) + C (associative law) 


A.7 SCALAR MULTIPLICATION OF A MATRIX 

Matrices can be multiplied by a scalar (i.e., a constant). Let k be any scalar 
quantity; then 

kA = Ak 

The following are examples 


3 

-1 


3 

-1 


12 

-4 

2 

6 


2 

6 

x 4 = 

8 

24 

4 

7 


4 

7 

16 

28 

5 

3 


5 

3 


20 

12 


As illustrated in the example above, each element of the matrix A is 
multiplied by the scalar k to obtain the elements of C. Note that 4 x A = 
A + A + A + A = Ax 4. 


A.8 MATRIX MULTIPLICATION 

If matrix A is to be post-multiplied by matrix B (i.e., the product of AB 
determined, the number of columns in matrix A must equal the number of 
rows in matrix B ). This is a basic requirement for matrix multiplication. When 
this condition is satisfied, the two matrices are said to be conformable for 
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multiplication. The product C will have the same number of rows as A and the 
same number of columns as B. Thus, the following multiplications are possible: 

4 A 2 x 2 5 3 = 4 C 3 
X A 2 x 

3 A 3 x 3 B l — 3 C l 

These multiplications are not possible: 

2 B 3 x 4 A 2 
6 A 2 x 6 B 3 


To demonstrate the process of matrix multiplication, consider the following 
example: 

b. 


2 A 3 x 3 B 2 


*21 


*12 
2 22 


’ll 

^12 

’21 

^22 

’31 

b 22 


'11 

'21 


— r 2 

- 2 «- 


The elements Cy of matrix C are the total sums obtained by successively 
multiplying each element in row i of matrix A by the elements in column j of 
matrix B , and then summing these products. Thus, for the example above. 


3 

c n = a n^n + fl i2^2i + a nb 3l = ^ d\ibi\ 

i=i 

3 

C 12 = a\\b\2 + a u b 2 2 + a nb 32 = ^ a uba 

1 = 1 

3 

C 21 = fl 21^11 + a 22^21 + a 23^31 = ^ a 2 A'l 

1=1 

3 

C 22 = a 21^12 + a 22^22 + a 23^32 = ^ a lPi2 

1=1 

The process above is seen more easily with a numerical example. 






’4 

8 _ 







1 

2 

3' 


6 

5 



c n 

c 12 


'31 

21' 

4 

2 

7 


z. 

3 


C 21 

c 22 


63 

57 


c n = 1(4)+ 2(6)+ 3(5) = 31 
c, 2 = 1(8)+ 2(2)+ 3(3) = 21 
c 21 = 4(4) + 2(6) + 7(5) = 63 
c 22 = 4(8) + 2(2) + 7(3) = 57 
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The student should now verify the matrix representation of Equations (A. 1) 
and (A.2). Notice that the product of a unit matrix, I, and a conformable 
matrix, A (one with the same number of rows as /), equals the original matrix A. 
Thus, 

a 


2 1 2 x 2 A 2 = 


1 

o' 

'5 6 


5 

6 

0 

1 

7 8 


7 

8 


— A ^ 

— 2 a 


Assuming that matrices /), B, and C are conformable for multiplication and 
in the order indicated, then the following are true. 


(c) A(B+C) = AB + AC 

(d) ( A+B)C=AC+BC 

(e) A(BC) = ( AB)C 

(f) ( AB) t = B t A t 


(first distributive law) 
(second distributive law) 
(associative law) 


The following cautions are also stated: 


(g) AB is not generally equal to BA, and BA may not even be conformable 
for multiplication. 

(h) If AB = 0, neither A nor B are necessarily = 0. 

(i) If AB = AC, B does not necessarily = C. 



2 1 


-1 -1 


1 f 

Let A = 

1 2 

, 5 = 

2 2 

, and C = 

1 1 


Example of (c): 
A{B+C)~- 


2 1 
1 2 

3 3 
6 6 


Example of (d) 1 : 

(A + B)C ■ 

Example of (e): 


0 0 
3 3 


AB+AC= 


0 0 
3 3 


+ 


1 

1' 


1 

r 

1 

1 


7 

7 


= AC + BC 


3 

3' 


-2 

-2 


1 

1 

3 

3 

+ 

4 

4 

— 

7 

7 


A(BC) = 


2 1 


-2 -2' 


0 O' 

1 2 


4 4 


6 6 


0 0 


1 1 


O 

o 

3 3 


1 1 


6 6 


= (AB)C 


'The multiplication symbol, X, is generally not written in matrix equations. This convention of 
not using x will be followed in this book. 
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Example of (f): 


Let A = 




3 2 



2 6 4 
1 2 7 

and B = 

9 0 

1 3 

, then AB = 

64 16' 
28 23 




L J 


so 


( AB) t = 


64 28 
16 23 


and B A 


T A T 


3 9 1 
2 0 3 


2 1 
6 2 
4 7 


64 28 
16 23 


Example of (g): 


AB = 


0 0 
3 3 


-3 -3 
6 6 


= BA 


Example of (h): 


Let A 


2 2 

1 1 


and B ■■ 


-1 -2 

1 2 


Then AB — 0, but neither A nor B equal 0. 
Example of (i): 


Let A = 


2 2 

1 1 


1 

1 3 


and 


4 10 
-2 -5 


Then AB = AC, but B / C, where AB = 


10 

5 


= AC 


A.9 COMPUTER ALGORITHMS FOR MATRIX OPERATIONS 

It should be apparent that addition, subtraction, and multiplication of large 
matrices involve many arithmetic operations. These are very tedious when 
done by hand, but can be done quickly by a computer. In this section, general 
mathematical expressions are developed for performing these operations using 
a computer. These general mathematical expressions, when programmed for 
computer solution, are called algorithms. 
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rJ" 

i 


+ 


+ 


S' 


C" 

u'-' 


FIGURE A.l Addition of matrices. 


TABLE A.l Addition Algorithm in BASIC, C, FORTRAN, and Pascal 


BASIC Language 

FORTRAN Language 

1000 For i = 1 to M 

Do 100 I = 1,M 

1010 For j = 1 to N 

Do 100 3 = 1,N 

1020 C(i,j) = A(i,j) + B(i,j) 

C(i , j) = A(i , j) + B(i , j) 

1030 Next j 

100 Continue 

1040 Next i 


C Language 

Pascal Language 

for (i=0; i<m; i++) 

For i := 1 to M do 

for (j=0; j<n; j++) 

For j := 1 to N do 

C[i] [j] = A[i][j] + B[i] [j]; 

C[i , j] := A[i , j] + B[i, j]; 


A.9.1 Addition/Subtraction of Two Matrices 

Consider the two matrices A and B that are shown in Figure A.l. Note 
that matrices A and B are conformable for addition. Find the sum of the two 
matrices and place the results in C. 

Step 1: Add the first element (a u ) of the A matrix to the first element (b n ) 
of 5, placing the result in the first element (c n ) of C. Repeat this process 
for each of the successive columns along the first row of A and B or from 
j= 1 to j = n. 

Step 2: Iterate step 1 for each successive row of the matrices, or for rows 
increasing from i = 1 to i = m. Table A.l shows this entire operation 
of adding two matrices in the four computer languages of BASIC, C, 
FORTRAN, and Pascal. 


A.9.2 Matrix Multiplication 

Consider the two matrices A and B that are shown in Figure A.2. Again, these 
matrices, A and B , are conformable for multiplication. Find the product A B 
and place the results in C. 
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nA P 

i 


k 


C" 


x / 


m. 


FIGURE A.2 Multiplication of matrices. 


Step 1: Sum the products (A row / = 1) x (B column k= 1), with the elements 
of A and B being increased successively from j = / to /= p. Place the result 
in c ik , or c n , for the first step. Mathematically, this step is represented as: 

p 

c ik = ^ a : jbj k with i = 1, and k = 1 
7=1 

Step 2: Increase k successively by 1, repeat step 1, and place the results in 
c ik . Continue increasing k and repeating step 1 until k = p. 

Step 3: Increase i from one to two, and repeat steps 1 and 2 in entirety. Upon 
completion with i = 2, increment i by one and repeat steps 1 and 2 again in 
entirety. Continue this process through i = m. This completes the matrix 
multiplication. 

This operation is shown Table A.2 in the four languages of BASIC, C, 
FORTRAN, and Pascal. As a final note on multiplication, it is essential that 
the order in which the matrices are multiplied be specified. 


TABLE A.2 Multiplication Algorithm in BASIC, C, FORTRAN, and Pascal 


BASIC Language 

For i = 1 to M 
For k = 1 to N 
C(i,k) = 0.0 
For j = 1 to P 

C(i,k) = C(i,k) + A(i, j)*B(j , k) 
Next j : Next k: Next I 

C Language 

for (i=0; i<m; i++) 
for (k=0; k<n; k++) { 

C[i] [k] = 0; 

for (j=0; j<p; j++) 

C[i] [k] = C[i][k] + A[i] [j]*B[j] [k]; 
} //for k 


FORTRAN Language 

Do 100 I = 1,M 
Do 100 K = 1,N 
C(i,k) = 0.0 

Do 100 J = 1,P 

C(i,k)=C(i,k)+A(i ,j)*B(j,k) 

100 Continue 

Pascal Language 

For i := 1 to M do 

For k := 1 to N do Begin 
C[i,k] := 0.0; 

For j := 1 to P do 
C[i,k] :=C[i,k] + A[i , j]*B[j , k] 
End; { for k } 
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A.10 USE OF THE MATRIX SOFTWARE 

A software package called MATRIX is included on the companion website 
that is provided with this book. It includes all the matrix operations that will 
be necessary to study the subject of adjustment computations and solve the 
after-chapter problems herein that require matrix manipulation. Instructions 
for use of the software are given in the help hie, which is part of the software. 

MATRIX reads the matrices from text hies and contains a text editor to 
create such hies. The hies are free format, which means that a space, comma, 
or tab can separate each entry. This also means that commas cannot be used 
as thousand’s separators in a single large number. Although the internal editor 
in MATRIX does not support tabs, a tab entry can be used to separate entries 
also. This feature is useful when cutting and pasting matrices from a spread¬ 
sheet. A hie of matrices from Section A. 8, which were used to demonstrate 
principles (c) and (d), is shown in Figure A.3 where the format of the hies is 

1. Job title. 

2. Matrix name. 

3. Number of rows and columns in matrix. 

4. List each element in the first row. 

5. Continue in the same manner for each subsequent row, by placing each 
row of a matrix on a new line. 

6. Repeat the lines 2 through 5 for each matrix. 

After creating the hie, it must be saved and read into the MATRIX software 
shown in Figure A.4 using the read file option under the matrices menu of the 
software. Once read into the software, the user can perform any of the matrix 
operations contained in the numerical operations menu. When an operation is 
selected, a matrix selection screen will appear. Figure A. 5 shows the selection 
screen after the multiplication option has been selected. Note that the previ¬ 
ous addition of matrices A and B are shown as A + B and the directions to 

Example matrices from Section A.8 
A 

2 2 
2 1 
1 2 
B 

2 2 
-1 -1 
2 2 
C 

1 1 
1 1 


FIGURE A.3 MATRIX data file. 
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FIGURE A.4 MATRIX software. 



FIGURE A.5 MATRIX selection screen for adding two matrices. 


the user shown at the top of the screen where it states select the first matrix 
A in the product of A B. There is a rename option under the matrices menu 
that allows the user to change the default name of a matrix to any name up 
to 20 characters long. Two options in the numerical operations menu allow the 
user to perform both a weighted and unweighted least squares adjustment as 
discussed in Chapter 11. These options create all of the intermediate matrices 
that are necessary to perform the adjustment and compute the post-adjustment 
statistics as presented in Chapter 13. 

Users can view the results any of the matrices using the view matrix option 
in the matrices menu. This option can be also accessed with the short-cut key 
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ctrl-v. The number of digits after the decimal point can be controlled by using 
the display options under the matrices menu. For example, since the additions 
of Section A.8 involved only integers, the user may select zero digits after the 
decimal point so that integers are displayed. To print the resulting matrices, 
the user simply needs to select the list matrix option in the matrices menu. The 
user will be prompted for the location and name of the resulting hie, which 
will be created to list the selected matrices. When this option is used, the user 
can select multiple matrices from the matrix selection screen. These matrices 
will be written to the user-specified hie using the display option specihed digits 
after the decimal point. Once saved, this hie can be read into the MATRIX 
editor and printed. The write file option in matrices menu allows the user to 
create a text hie, which is readable by MATRIX, of all the matrices shown in 
the selection screen. The matrices will be written in scientific notation so that 
no accuracy is lost between the saving and reading of the resultant hie. 


PROBLEMS 

A.l Represent the following system of linear equations in matrix form as 
AX = B. 


+ x 4 — 5 

x \ + x 2 ~ 3x 3 + 4.v 4 = -1 
3x[ + 6.v 2 - 2x 3 + x 4 = 8 
2x 1 + 2x 2 + 2x 3 — 3.v 4 = 2 

A.2 For Problem A.l, find the product of A r A. 

A.3 Do the following matrix operations 



1 

2 

-1 

O' 


"3 

-4 

1 

2 

(a) 

4 

0 

2 

1 

+ 

1 

5 

0 

-3 


2 

-5 

1 

2 


2 

-2 

3 

-1 


1 

2 

-1 

O' 


"3 

-4 

1 

2" 

(b) 

4 

0 

2 

1 

- 

1 

5 

0 

3 


2 

-5 

1 

2 


2 

-2 

3 

-1 


(c) 


2 

0 

-5 


-1 0 

2 1 

1 2 


(d) 


1 2 1 
4 0 2 


3 

1 

-2 


-4 

5 

2 
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0 
0 

(a) Find AB. 

(b) Find B 2 . 

(c) Find CB. 

(d) Find BA. 

(e) Find B . 

(f) Find DB. 

(g) Find C 3 . 


A.4 Solve Problem A.2 using the MATRIX software. 

A.5 Solve Problem A.3 using the MATRIX software. 

'4 -1 
0 2 


A.6 Let A = 


2 0 
3 1 


B = 


C = 


1 0 
0 1 


D = 


A.7 Do Problem A.6 using the MATRIX software. 

A.8 Multiply the following, if possible. If not possible, give reasons why the 
multiplication cannot be done. 


A.9 




2 ] 


(b) [3 


3 ] 


4 

0 

9 





0 2 


"2 

3 4 4 


(C) 

1 

0-16 

D 1 

i n 


0 

1 2 9 

1 u 




0 -1 

(d) 

2 

0 

[3 -1] 



Expand the following summations into their equivalent algebraic 
expressions. 

5 


(a) Yj k 

k= 1 


(b) 2>- 2) 

k =3 

4 

(C) 

k= 1 
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(d) ^ a 2k C, k3 
k= 1 

3 4 

(e) + V 

i=i y=i 

2 2 3 

w ZZZ a * b v 

(=1 7=1 k= 1 

A.10 Write the algebraic expressions for the system of equations represented 
by the following matrix notation. 


2 0 




~2 

1 3 


x i 

— 

1 

4 2 


x 2 


3 


A.ll Show that in general, ( AB ) T = B J A r . 


PROGRAMMING PROBLEMS 

A.12 Write a program that will read and write the elements of a matrix, com¬ 
pute the transpose of the matrix, and write the solution. (Hint: Place 
the reading, writing, and transposition codes in separate subroutines/ 
procedures/functions to be called from the main program.) 

A.13 Select one of the matrix addition codes from Table A.l and enter it and 
any necessary supporting code to solve Problem A.3(a). (Hint: Place 
the code in Table A. 1 in a separate subroutine/procedure/function to be 
called from the main program.) 

A.14 Select one of the matrix multiplication programs from Table A.2, and 
enter this code and any necessary supporting code to solve Problem 
A.3(d). (Hint: Place the code in Table A.2 in a separate subroutine/ 
procedure/function to be called from the main program.) 

A.15 Write a program that will read and write a hie of matrices, and do the 
matrix operations of transposition, addition, subtraction, and multi¬ 
plication. Demonstrate the program by doing Problems A.2 and A.3 
(a), (b), and (d). (Hint: Place the reading, writing, transposition, addi¬ 
tion, subtraction, and multiplication, codes in separate subroutines/ 
procedures/functions to be called from the main program.) 

A.16 Write a Mathcad worksheet that solves Problems A.3 and A.6. 








APPENDIX B 


SOLUTION OF EQUATIONS BY MATRIX 
METHODS 


B.1 INTRODUCTION 

As stated in Appendix A, an advantage offered by matrix algebra is its 
adaptability to computer usage. Using matrix algebra, large systems of 
simultaneous linear equations can be programmed for general computer 
solution using only a few systematic steps. For example, the simplicities of 
programming matrix additions and multiplications were presented in Section 
A.9. To solve a system of equations using matrix methods, it is first necessary 
to define and compute the inverse matrix. 


B.2 INVERSE MATRIX 

^3 If a square matrix is nonsingular (its determinant is not zero), it possesses 
an inverse matrix. When a system of simultaneous linear equations consisting 
of n equations and involving n unknowns is expressed as AX = B , the coefficient 
matrix (A) is a square matrix of dimensions n x n. Consider this system of linear 
equations 

AX=B (B.l) 


The inverse of matrix A, symbolized as A 1 , is defined as 

A~ l A = I 


(B.2) 


Adjustment Computations: Spatial Data Analysis, Sixth Edition. Charles D. Ghilani. 
© 2018 by John Wiley & Sons, Inc. Published 2018 by John Wiley & Sons, Inc. 
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where / is the identity matrix. Premultiplying both sides of matrix 
Equation (B.l) by A~ l gives 


A~ x AX = A~ l B 


Reducing yields 


IX = A~ X B 

X = A~ l B (B.3) 

Thus, the inverse is used to find the matrix of unknowns, X. The following 
points should be emphasized regarding matrix inversions: 

1. Square matrices have inverses, with the exception noted below. 

2. When the determinant of a matrix is zero, the matrix is said to be singular 
and its inverse cannot be found. 

3. The inversion of even a small matrix is a tedious and time-consuming 
operation when done by hand. However, when done by a computer, the 
inverse can be found quickly and easily. 


B.3 THE INVERSE OF A 2 x 2 MATRIX 


Several general methods are available to find a matrix inverse. Two shall be 
considered herein. However, before proceeding with general cases consider the 
specific case of finding the inverse for a 2 x 2 matrix using simple elementary 
matrix operations. Let any 2x2 matrix be symbolized as A. Also, let 


A = 


a 

c 


b 

d 


and A 1 


w x 

y 2 


By applying Equation (B.2) and recalling the definition of an identity 
matrix I as given in Section A.4, it is possible to calculate w, x, y, and z in 
terms of a, b, c, and d of A ~ x . Substituting in the appropriate values gives 


a b 

w 

X 


1 

o' 

c d 

y 

Z 


0 

l 


aw + by = 1 

{a) 

ax + bz = 0 

(b) 

cw + dy = 0 

(c) 

cx + dz = 1 

(d) 


By matrix multiplication 
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The determinant of A is symbolized as Mil and equal to ad - be. 
1 — aw 

; urom ^D)y =-- 

n 

d 


From (a) y = 


; From (b)y = —- 
, b d 

^ \ — aw cw „ , . d 

then—-— = —Reducing: w = 


da —be Mil 

From (A) z = - C ^-\ From(r/)z = -— 

, b d 

ax 1 — ex t , , • b —b 

then - — = ——; Reducing: x = —-— = —— 

b d -da + bc ||^ 4 || 


1 - by dy 

From (a) w = -; From (c) w = —— 

ti 1 - by U dy . c 

then-=-; Reducing: y = 


From ( b ) x 


bz 


From (d) x = 


ad+cb H^ll 
1 — dz 


a c 

bz 1 — dz „ , . a a 

then-=-; Reducing: z = ——— = —— 

a c ad—be ||^4|| 


Thus, for any 2x2 matrix composed of the elements 
simply 


a b 
c d 


, its inverse is 


Example B.l I f A = 
SOLUTION 


r d 

-b 1 



Mil 

Mil 

1 

d —b 

—c 

a 

“ Mil 

—c a 

Lmii 

MIU 



2 3' 

4 1 

, find A 

-i 



MU =2(1)-4(3) = -10; 



-3 

2 


A check on the inverse can be obtained by testing it against its definition, or 
A~ l A = I. Thus, 


1 

1 

-3 

2 3 


1 

0 

10 

-4 

2 

4 1 


0 

1 
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B.4 INVERSES BY ADJOINTS 

The inverse of A can be found using the method of adjoints with the following 
equation: 

adjoint of A adjoint of A (B 4) 

determinant of A \\A\\ 

The adjoint of A is obtained by first replacing each matrix element by its 
signed minor or cofactor, and then transposing the resultant matrix. The cofac¬ 
tor of element ay equals (-1 )' +J times the numerical value of the determinant for 
the remaining elements after row i and column j have been removed from the 
matrix. This procedure is illustrated in Figure B.l where the cofactor of a u is 

(~l) 1+ “( fl 21 a 33 — fl 31 fl 23) = fl 31 a 23 — fl 21 fl 33 

Using this procedure, the inverse of the following A matrix is found: 


A = 

a n 

a 2l 

a \2 fl 13 
a 22 a 22 

_ 

"4 3 2 

3 4 1 


fl 3 l 

a 32 a 33 


2 3 4 


For this A matrix, the cofactors are calculated as follows: 


cofactor offl n = (— 1 ) 2 (4 x 4 - 1 x 3) = 13 
cofactor of a 2l = (— 1 ) 3 (3 x 4 - 2 x 3) = -6 
cofactor of a 31 = (— 1 ) 4 (3 xl-2x4) = -5 
cofactor of a n = (— 1 ) 3 (3 X 4 - 1 x 2) = -10 



FIGURE B.l Cofactor of the a u element. 
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Following the procedure above, the matrix of cofactors is 


matrix of cofactors = 


13 

-6 

-5 


-10 

12 

2 


1 

-6 

7 


Transposing this cofactor matrix produces the following adjoint of A: 


adjoint of A = 


13 

-10 

1 


-6 

12 

-6 


-5 

2 

7 


The determinant of A is the sum of the products of the elements in the first 
row of the original matrix times their respective cofactors. Since the cofactors 
were already obtained in the previous step, this simplifies to 


MU = 4(13) + 3(—10) + 2(1) = 24 
The inverse of A is now calculated as 


13 -6 

-5 


13/24 

-1/4 

-5/24 

-10 12 

2 

= 

-5/12 

1/2 

1/12 

1 -6 

7 


1/24 

-1/4 

7/24 


Again, a check on the arithmetical work is obtained by using the definition 
of an inverse: 



13/24 

-1/4 

-5/24 

'4 

3 

2 


"l 

0 

o' 

AA-' = 

-5/12 

1/2 

1/12 

3 

4 

1 

= 

0 

1 

0 


1/24 

-1/4 

7/24 

2 

3 

4 


0 

0 

1 


B.5 INVERSES BY ELEMENTARY ROW TRANSFORMATIONS 

[CH A system of equations can be modified using the following three steps 
without changing its solution: 

1. The multiplication of every element in any row by a nonzero scalar. This 
is simply scaling the equation. Thus, if the original equation is 2x = 4 and 
this equation is scaled by three the resultant equation 6x = 12 still as the 
same solution of x = 2. 
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2. The addition (or subtraction) of the elements in any row to the elements 
of any other row. 

3. Combinations of 1 and 2. 

If elementary row transformations are successively performed on A such 
that A is transformed into I, and if throughout the procedure the same row 
transformations are also done to the same rows of the identity matrix /, the 
/ matrix will be transformed into A' 1 . This procedure is illustrated using the 
same matrix used to demonstrate the method of adjoints. 

Initially, the original matrix and the identity matrix are listed side by side: 

A I 

'4 3 2 | 10 0" 

3 4 1|010 
2 3 4|001 

With the following three-row transformations performed on A and /, they 
are transformed into matrices A , and /), respectively: 

1. Multiply row 1 of matrices A and / by 1 la n or 1/4. Place the results in 
row 1 of A x and I x , respectively. This converts a n of matrix A l to 1, as 


shown below. 

1 

3/4 

1/2 

1/4 

0 

0 


3 

4 

1 

0 

1 

0 


2 

3 

4 

0 

0 

1 


2. Multiply row 1 of matrices A 1 and I { by a 2 \ or 3. Subtract the resulting 
row from row 2 of matrices A and / and place the difference in row 2 of 
A | and /,, respectively. This converts a 2 \ of A 1 to zero. 

3. Multiply row 1 of matrices A 1 and I x by a 31 or 2. Subtract the resulting 
row from row 3 of matrices A and / and place the difference in row 3 of 
A | and /,, respectively. This changes a 31 of A , to zero. 

After doing these operations, the transformed matrices A 1 and I x are 



A-l 


h 



1 

3/4 

1/2 

1/4 

0 

O' 

0 

7/4 

-1/2 

-3/4 

1 

0 

0 

3/2 

3 

-1/2 

0 

1 
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Notice that the first column of A x is equivalent to the first column of a 3 X 3 
identity matrix as a result of these three-row transformations. For matrices 
having more than three rows, this same general procedure would be followed 
for each row to convert the first element in each row of A , to zero, with the 
exception of the first row of A. 

Next, the following three elementary row transformations are done on 
matrices A 1 and /, to transform them into matrices A 2 and I 2 : 

1. Multiply row 2 of A , and I x by Ha 22 or 4/7 and place the results in row 2 
of A 2 and I 2 . This converts a 22 to 1, as shown below. 

1 3/4 1/2 | 1/4 0 O’ 

0 1 -2/7 | -3/7 4/7 0 

03/2 3 | -1/2 0 1 

2. Multiply row 2 of A 2 and I 2 by a u or 3/4. Subtract the resulting row 
from row 1 of A 1 and /, and place the difference in row 1 of A 2 and I 2 , 
respectively. 

3. Multiply row 2 of A 2 and I 2 by a 32 , which is 3/2. Subtract the resulting 
row from row 3 of A , and / and place the difference in row 3 of A 2 and 
I 2 , respectively. 

After doing these operations, the transformed matrices A 2 and I 2 are: 

A 2 I 2 

1 0 5/7 I 4/7 -3/7 o' 

0 1 -2/7 | -3/7 4/7 0 

0 0 24/7 | 1/7 -6/7 1 

Notice that after this second series of steps is completed, the second column 
of A 2 conforms to column two of a 3 X 3 identity matrix. Again, for matrices 
having more than three rows, this same general procedure would be followed 
for each row, to convert the second element in each row (except the second row) 
of ^4 2 t° zero. 

Finally, the following three-row transformations are applied to matrices A 2 
and I 2 to transform them into matrices A 3 and / 3 . 
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1. Multiply row 3 of A 2 and I 2 by l/a 33 or 7/24 and place the results 
in row 3 of A 3 and / 3 , respectively. This converts a 33 to 1, as shown 
below. 

'l 0 5/7 | 4/7 -3/7 0 ' 

0 1 -2/7 | -3/7 4/7 0 

00 1 | 1/24 -1/4 7/24 

2. Multiply row 3 of A 2 and I 2 by a 13 or 5/7. Subtract the results from 
row 1 of ^4 2 and h and place the difference in row 1 of ^4 3 and / 3 , 
respectively. 

3. Multiply row 3 of A 2 and I 2 by a 2 3 or -2/7. Subtract the results from row 
2 of A 2 and I 2 and place the difference in row 2 of A-, and / 3 . 

Following these operations, the transformed matrices A 3 and / 3 are: 

A 3 I 3 = A~ l 

100| 12/24 -1/4 -5/24' 

0 1 0 | -5/12 1/2 1/12 

0 0 1 | 1/24 -1/4 7/24 

Notice that through these nine elementary row transformations, the original 
A matrix is transformed into the identity matrix and the original identity matrix 
is transformed into A~ l , which can be verified by multiplying it by the A matrix. 
Also note that A~ l obtained by this method agrees exactly with the inverse 
obtained by the method of adjoints. This is because any nonsingular matrix 
has a unique inverse. 

It should be obvious that the quantity of work involved in inverting 
matrices greatly increases with the matrix size, since the number of nec¬ 
essary row transformations is equal to the square of the number of rows 
or columns. Because of this, it is not considered practical to invert large 
matrices by hand. This work is more conveniently done with a computer. Since 
the procedure of elementary row transformations is systematic, it is easily 
programmed. 

Table B. 1 shows algorithms, written in BASIC, C, FORTRAN, and Pascal 
programming languages, for calculating the inverse of any n x n nonsingular 
matrix A. Students should review the code in their preferred language to gain 
familiarity with the computer procedures. 






Inverse Algorithm in BASIC, C, FORTRAN, and PASCAL 
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if Cj !=k) A[i] [j] = A[i] [j] - A[i] [k]*A[k] [j] ; If (jok) then A[i , j] := A[i ,j] - A[i ,k]*A[k, j]; 

A[i] [k] = -A [ i ] [k]*A[k] [k]; A[i,k] := -A[i , k]*A[k, k] ; 

} //if iok End; { If iok } 
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B.6 EXAMPLE PROBLEM 

Example B.2 Suppose that an EDM instrument is placed at point A in 
Figure B.2 and a reflector is successively placed at B, C, and D. The observed 
values AB, AC, and AD are shown in the figure. Calculate the unknowns X x , 
X 2 , and X 3 by matrix methods. The observed values are: 

AB = 125.27 
AC = 259.60 
AD = 395.85 



ABC D 

FIGURE B.2 Observation of a line. 


SOLUTION Formulate the basic equations: 

lX x +0X 2 + 0X 3 = 125.27 
1 Xf + 1X 2 + 0X 3 = 259.60 
\X x + 1X 2 + 1X 3 = 395.85 

Represented in matrix notation, these equations are AX — L. In this matrix 
equation, the individual matrices are: 


A = 

1 0 O' 

1 1 0 

X = 

H X ' 

IO 

_1 

L = 

125.27' 

259.60 


1 1 1 


*3. 


395.85 


The solution in matrix notation is X = A~ l L. Using elementary row trans¬ 
formations, the inverse of A is 


'l 

0 

0 

1 

0 

o' 


1 

0 

0 l 

1 

0 

o' 

1 

1 

0 

0 

1 

0 


0 

1 

0 l 

-1 

1 

0 

1 

1 

1 

0 

0 

1 


0 

0 

1 1 

0 

-1 

1 
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Solving X = A l L , the unknowns are 


1 

0 

0 

"125.27" 


125.27" 

-1 

1 

0 

259.60 

= 

134.33 

0 

-1 

1 

395.85 


136.25 


X x = 125.27 
X 2 = 134.33 
X 3 = 136.25 


PROBLEMS 


B.l Explain when a 2 x 2 matrix has no inverse. 

B.2 Find the inverse of A using the method of adjoints 


A = 


3 

-1 

-1 


-1 -1 
3 -1 
-1 3 


B.3 Find the inverse of A in Problem B.2 using elementary row transforma¬ 
tions. 

B.4 Solve the following system of linear equations using matrix methods. 


x + 5y = -8 
—x — 2y = —\ 

B.5 Solve the following system of linear equations using matrix methods. 


x + y — z = -8 
3x — y + z = -4 

-x + 2 y + 2z = 21 


B.6 Compute the inverses of the following matrices. 


A = 


8 

3 


5 

12 


B = 


16 2 
-8 3 


B.7 Compute the inverses of the following matrices. 


3 

-1 

O' 


4 

3 

7' 

-1 

3 

-1 

B = 

-1 

0 

4 

0 

-1 

3 


2 

8 

10 
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B.8 Compute the inverses of the following matrices. 


'13 

-6 

O' 


1 

2 

6' 

-6 

18 

-6 

B = 

2 

-3 

4 

0 

-6 

16 


0 

6 

-12 


B.9 Solve the following matrix system. 


'13 -6 0' 


~A 


' 740.02' 

-6 18 -6 


B 

= 

612.72 

0 -6 16 


C 


1072.22 


Use the MATRIX software to do each problem. 

B.10 Problem B.4. 

B.ll Problem B.5. 

B.12 Problem B.6. 

B.13 Problem B.7. 

B.14 Problem B.8. 

B.15 Problem B.9. 

PROGRAMMING PROBLEMS 

B.16 Select one of the coded matrix inverse routines from Table B.l, enter 
the code into a computer and use it to solve Problem B.7. (Hint: Place 
the code in Table B.l in a separate subroutine/function/procedure to be 
called from the main program.) 

B.17 Add a block of code to the inverse routine in the language of your choice 
that will inform the user when a matrix is singular. 

B.18 Write a program that reads and writes a hie with a nonsingular matrix; 
finds its inverse, and writes the results. Use this program to solve 
Problem B.7. (Hint: Place the reading, writing, and inversing code in 
separate subroutines/functions/procedures to be called from the main 
program. Provide a way to identify each matrix in the output hie.) 

B.19 Write a program that reads and writes a hie containing a system of 
equations written in matrix form, solves the system using matrix oper¬ 
ations, and writes the solution. Use this program to solve Problem B.9. 
(Hint: Place the reading, writing, and inversing code in separate subrou¬ 
tines/functions/procedures to be called from the main program. Provide 
a way to identify each matrix in the output hie.) 












APPENDIX C 


NONLINEAR EQUATIONS 
AND TAYLOR’S THEOREM 


C.1 INTRODUCTION 

In adjustment computations, it is frequently necessary to deal with nonlinear 
equations. For example, some observation equations relate observed quantities 
to unknown parameters through the transcendental functions of sine, cosine, 
or tangent, while others relate them through terms raised to second- and 
higher-order powers. The task of solving a system of nonlinear equations is 
formidable. To facilitate the solution, a first-order Taylor series approximation 
can be used to create a set of linear equations. The equations can then be 
solved by matrix methods discussed in Appendix B. 

C.2 TAYLOR SERIES LINEARIZATION OF NONLINEAR EQUATIONS 

^3 Suppose that the following equation relates an observed value L to its 
unknown parameters x and y through nonlinear coefficients as 


L =f(x,y ) 

By Taylor’s theorem, the equation can be represented as 


(C.l) 


L =f(x,y ) =f(x 0 




(C.2) 
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In Equation (C.2), x 0 and y 0 are approximations for x and y;/(.v 0 , y 0 ) is the 
nonlinear function evaluated at these approximations; R is the remainder, and 
dx and dy are corrections to the approximations, such that 


X = A'o + dx 
y = y 0 +dy 


(C.3) 


A more exact Taylor series approximation is obtained by increasing the 
value of n in Equation (C.2). Elowever, as the order of each successive term 
increases, its significance in the overall expression decreases. If all terms 
containing derivatives higher than the first are dropped, the following linear 
expression is obtained: 



(C.4) 


Once the initial approximations are selected, the only unknowns in 
Equation (C.4) are the corrections dx and dy. Of course, by dropping the 
higher-order terms from the Taylor series, Equation (C.4) becomes only a 
good approximation of the original equation. However, an iterative procedure 
can be followed in the solution that yields accurate results. This iterative 
procedure uses the following steps: 

Step 1: Determine initial approximations for the unknowns. They may be 
obtained by guessing or from observations. It should be understood that 
the closer the initial approximations are to the final solution, the faster the 
final solution will be obtained. For some problems, initial approximations 
are obtained from graphical solutions or computed from available data 
or observations. For others, the determination of initial approximations 
can involve considerable computational effort. 

Step 2: Substitute the initial approximations into Equation (C.4) and solve 
for the corrections dx and dy. 

Step 3: Calculate revised values of x and y using Equations (C.3). 

Step 4: Using these newly revised values for x and y, repeat steps 2 and 3. 

Step 5: Continue the above procedure until the corrections dx and dy are 
small enough to bring x and y within tolerable accuracy. When this 
occurs, the solution is said to have converged. 

C.3 NUMERICAL EXAMPLE 

To clarify this procedure further, a numerical example will be solved. 

Example C.l Linearize the following pair of nonlinear equations containing 
the two unknowns x and y and solve for the unknown parameters x and y. 


F: x + y - 2 y 2 = -4 
G: x 2 + y 2 = 8 
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SOLUTION Determine the partial derivative for each equation with respect 
to each unknown. 

n#/ nA - 

■ 4 y 


— = 1 

dx 


— = 1 

dy 


dG . dG . 
7 - = 2 .x: — = 2 j 

dx dy 


Compute an approximate solution. An estimate of x = 1 and y = 1 is used 
for the approximations initially. 

First Iteration: Write the linearized equations in the form of Equation (C.4). 


F: dx+ [1 -4(1)]4> = -4 - (1 + 1 -2(1) 2 ) 
G: 2(l)dx + 2{\)dy = 8 - (l 2 + l 2 ) 


From these two equations, solve for the unknowns dx and dy according to 
Equation (C.3): 


dx = 1.25 and dy = 1.75 


Using this solution, determine updated values for x and y: 

x = x 0 + dx = 1 + 1.25 = 2.25 
y = y 0 + dy = 1 + 1.75 = 2.75 

Second Iteration: Continue the procedure demonstrated for the first 
iteration. 

F: dx + [1 - 4(2.75 )]dy = -4 - (2.25 + 2.75 - 2(2.75) 2 ) 

G: 2(2.25 )dx + 2{2.15)dy = 8 - (2.25 2 + 2.75 2 ) 

From these two equations, dx = -0.25 and dy = -0.64, from which 

x = x 0 + dx = 2.25 - 0.25 = 2.00 
y — y {) + dy = 2.75 - 0.64 = 2.11 

Third Iteration: Substitute the new approximations into the equations and 
solve the equations for the unknown parameters. 

F: dx + [1 - 4(2.11 )\dy = -4 - (2.00 + 2.11 - 2(2.11 ) 2 ) 

G: 2(2.00 )dx + 2(2.11)4’ = 8 - (2.00 2 + 2.11 2 ) 

From these two equations, dx = 0.00 and dy = -0.11, from which 

x = x 0 + dx = 2.00 + 0.00 = 2.00 
y = y Q + dy = 2.11 - 0.11 = 2.00 
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Fourth Iteration: Continue the iteration procedure. 

F: dx + [1 - 4(2.00)Jc/>’ = -4 - (2.00 + 2.00 - 2(2.00) 2 ) 

G: 2(2.00 )dx + 2(2.00)dy = 8 - (2.00 2 + 2.00 2 ) 

Using the two previous equations, the corrections to x and y are zero to the 
nearest hundredth. Thus, the solution has converged and the values of x = 2.00 
and y = 2.00 are the desired unknowns. Note that the initial values for the 
approximations were relatively poor and four iterations were required to find 
the final solution. However, had better estimates been made (say, x 0 = 2.1 
and y 0 = 1.9), the solution would have converged in one or two iterations 
and saved computational effort. Fortunately, there are accepted computational 
procedures to determine close approximations in most surveying problems. 


C.4 USING MATRICES TO SOLVE NONLINEAR EQUATIONS 

The example of Section C.3 could be solved using matrix methods. 
However as in the algebraic approach, the equations must be linearized using 
Taylor series. To facilitate linearization using Taylor’s theorem, a Jacobian 
matrix (a matrix consisting of the partial derivatives taken with respect to the 
unknown variables) is formed. This is the coefficient matrix of the linearized 
equations. The Jacobian matrix for the example of Section C.3 is 


-dF 

dF- 

dx 

dy 

dG 

dG 

. dx 

dy- 


In the preceding Jacobian matrix, the first column contains the partial 
derivative for each equation with respect to x, and the second column contains 
each the partial derivative of each equation with respect to y. The linearized 
form of the equations can then be expressed in matrix notation as 


JX = K (C.5) 

In Equation (C.5), / is the Jacobian matrix, X the matrix of unknown cor¬ 
rections dx and dy, and K the matrix of constants. Specifically for the example 
of Section C.3, these matrices are 


© 

4F' 

l 

X = 

dx 

K = 

-4 - F(x 0 ,y 0 ) 

2 x 0 2y 0 


dy 


8 -G(x 0 ,y 0 ) 


where F(x 0 , y 0 ) and G(x 0 , y 0 ) are the equations F and G solved at the approxi¬ 
mates of x () and y 0 . 











C.5 SIMPLE MATRIX EXAMPLE 623 


Beginning with a set of approximations jc 0 and v 0 , the J and K matrices of 
Equation (C.5) are formed. Xis computed using the matrix methods presented 
in Appendix B. Having updated the unknowns according to Equations (C.3), 
the J and K matrices are formed again and the solution for X computed again. 
This procedure is iterated until convergence is achieved. 


C.5 SIMPLE MATRIX EXAMPLE 


Example C.2 Find the solution of the nonlinear system of equations shown 
below using matrix methods. 

F: x 2 + 3 xy - Ay 2 = 6 
G : x + xy - y 2 = 3 


SOLUTION The partial derivatives of functions F and G with respect to the 
unknown’s, x and y, are 


dF 

dx 


2x + 3 y 


dG 

dx 


= l+y 


Thus, the Jacobian matrix is 


dF 

dy 


= 3x - 


dG 

dy 


x — 2y 


dF 

df 




dx 

dy 


2x 0 + 3 y 0 

LO 

X 

O 

1 

OO 

o 

dG 

dx 

dG 

dy 


1 +Lo 

X 

o 

1 

V* 

o 


The system of equations to solve is 


2x 0 + 3 y 0 3x 0 - 8y 0 


dx 


6 -F(x 0 ,y 0 ) 

1 + Lo *o “ 2 ko _ 


dy 


3 - G(x 0 ,y 0 ) 


First Iteration: Using the approximate solution of x 0 = 3 and y 0 = 0 yields 


6 9 

dx 


6-9 


-3 

1 3 

dy 


3-3 


0 


The determinant for the Jacobian matrix above is 3(6) - 9(1) = 9, and thus 
the matrix solution is 


dx 

1 

3 -9 

-3 


-1.0 

dy 

“ 9 

-1 6 

0 


0.3 
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Applying Equation (C.3), the new approximations for the unknowns used 
in the second iteration are 


X 


x 0 


dx 


3 


-1 

y 

— 

Lo 

+ 

dy 

— 

0 

+ 

0.3 


2.0 

0.3 


Second Iteration 


'4.9 

3.6' 

dx 


6 - 5.44' 


0.56' 

1.3 

1.4 

dy 


3-2.51 


0.49 


From this, dx and dy are found to be 0.45 and 0.77, respectively. This makes 
the approximation for the unknowns of x and y for the third iteration as 1.55 
and 1.07, respectively. These procedures are followed until the final solution 
for x and y is found to be 2.00 and 1.00, respectively. Again, fewer iterations 
would have been required if the initial approximations had been closer to the 
final values. 


C.6 PRACTICAL EXAMPLE 

Example C.3 Assume that the x and y coordinates of three points on a cir¬ 
cle have been observed. Their coordinates are (9.4, 5.6), (7.6, 7.2), and (3.8, 
4.8), respectively. The equation for a circle with center (h, k ) and radius r is 
(x - h ) 2 + (y - k) 2 = r 2 . Determine the coordinates of the center of the circle 
and its radius. 

SOLUTION The equation of a circle is rewritten as C(h, k, r) = (x - h) 2 + 
(y - k) 2 - r 2 = 0. The partial derivatives with respect to the unknowns h, k, 
and r are 


dC 

dh 


= —2(x - h) 


dC 

dk 


-2(y - k) 


dC 

dr 


= -2 r 


For each point observed, one equation is written, resulting in a system of 
three equations and three unknowns. The general linearized form of these 
equations expressed using matrices is 


'aQ 

dC, 

dC x 

dh 

dk 

dr 

d_C2 

dC2 

dC 2 

dh 

dk 

dr 

dC 3 

dC 2 

dC 3 

. dh 

dk 

dr 


dh 


dk 

= 

dr 



0 - [(x, - h 0 ) 2 + Oi - k 0 ) 2 - 
0 - \{x 2 - h 0 ) 2 + O 2 - h) 2 - 
0 - [(x 3 - h 0 ) 2 + O 3 - k 0 ) 2 ~ 


r o. 

1 

a 


(C.6) 
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After taking partial derivatives, Equation (C.6) becomes 


o 

1 

pT 

fT 

i 

i_ 

— 20T - k 0 ) 

~2r 0 

dh 

-2(x 2 - h {] ) 

-2 (y 2 - k 0 ) 

~2 r 0 

dk 

-2(.x 3 - h 0 ) 

-2(y 3 - k 0 ) 

l 

O 

(N 

1 

dr 


0 - [Cxj - h 0 ) 2 + 0’i - k 0 ) 2 - r]\ 

0 - [(x 2 - h 0 ) 2 + (y 2 - k 0 ) 2 - r 2 ] 

0 - [(x 3 - h 0 ) 2 + 0 3 - k 0 ) 2 - r 2 ] _ 

(C.7) 


Equations (C.7) can be simplified by multiplying each side by -1/2. 
The resulting equations are 


C*i - K) 

Q 

i 

o 

r 0 

dh 

(x 2 - h 0 ) 

Q 

to 

i 

o 

>'o 

dk 

(x 3 - h 0 ) 

Q 

i 

O 

? ' 0 . 

dr 


0.5 [(.V! - h 0 ) 2 + (Ji - k 0 ) 2 - r 2 ] 
0.5 [(x 2 - h 0 ) 2 + (. y 2 ~ k 0 ) 2 - r 2 } ] 
0.5 [(x 3 - h 0 ) 2 + (y 3 - k 0 ) 2 - r 2 ] 


(C.8) 


Assuming approximate values for h, k, and r as 7, 4.5, and 3, respectively, 
Equations (C.8) are 


’(9.4 - 7) (5.6 - 4.5) 3 _ 

dh 


0.5 [(9.4 - l) 2 + (5.6 - 4.5) 2 - 3 2 ]’ 

(7.6 - 7) (7.2 - 4.5) 3 

(3.8 - 7) (4.8 - 4.5) 3 

dk 

dr 

~ 

0.5 [(7.6 - 7) 2 + (7.2 - 4.5) 2 - 3 2 ] 
0.5 [(3.8 - 7) 2 + (4.8 - 4.5) 2 - 3 2 ] 


Simplifying Equations (C.9) yields 


2.4 

1.1 

3’ 

'dh 


’-1.015’ 

0.6 

2.7 

3 

dk 

= 

-0.675 

-3.2 

0.3 

3 

dr 


0.665 


Solving this system gives results of 


dh 


-0.28462’ 

dk 

= 

-0.10769 

dr 


-0.07115 


After applying these changes to the approximation values for the unknowns, 
updated values for h, k, and r of 6.7154, 4.3923, and 2.9288, respectively, are 
obtained. The second iteration results in corrections of 0, 0, and 0.014945. 
Since the correction for r is still comparatively large, the iteration process must 
continue. After the third iteration, suitable convergence was achieved. The final 
values for h, k, and r are 6.72, 4.39, and 2.94, respectively, which are within 
0.00001 of a perfect solution. 
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Sometimes, more than one method is available for solving a prob¬ 
lem. For example, in the preceding problem an alternative linear form of the 
equation of a circle could be used. That equation is x 2 + y 2 + 2 dx + ley + /= 0, 
w here the cen ter of the circle is at (-d, -e ) and the circle’s radius is found as 
\[d 2 -ye 1 —/. Note that the equation is linear in terms of its unknowns (d, e, J), 
and thus iterations are not necessary in solving for the unknowns. Writing 
a rearranged form of this linear equation for each of three observed sets of 
(x, v) coordinates yields 

2dx\ + 2 ey x +f = -{x 1 + y 1 ) 

ldx 2 + ley 2 +f = ~(x\ + y\) (C. 10) 

ldx 2 + ley 2 + / = -(Xj + y 2 ) 

Equations (C.10) can, in turn, be represented in matrix notation as 


2x| 2y 1 1 

~d 


-Oi + y\) 

2x 2 ly 2 1 

e 

= 

~(x\ +y%) 

2x 3 ly 2 1 

/ 


-(*3 + k 3) 


Solving this matrix system, the center of the circle is again found to be (6.72, 
4.39) and its radius is determined to be 2.94. 

C.7 CONCLUDING REMARKS 

In this appendix, the Taylor series has been applied to solve for the unknowns 
in nonlinear equations. Many equations in surveying, geodesy, and photogram- 
metry are nonlinear. In surveying, examples include the distance and angle 
formulas that are nonlinear in terms of station coordinates. The Taylor series is 
used to linearize these equations and find least squares solutions. Thus, when 
performing least squares adjustments of plane observations, the techniques 
presented in this appendix must be used in the solutions. 

The MATRIX software can be used in conjunction with a spreadsheet 
to solve these nonlinear problems. As an example, matrices for Example 
C.3 are formulated using a spreadsheet as shown in Figure C.l. The “hnal” 
values for h, k , and r are formed by summing the columns to their left. These 
values are used to formulate the J and K matrices. Thus, as the updates to the 
approximate values for the unknowns are entered into the appropriate cells, 
the matrices are automatically updated. These updated matrices can then 
be cut and pasted directly into the MATRIX editor, saved, and the problem 
solved. Of course, for small problems such as this, the matrix routines available 
in most spreadsheets can be used also. This was done in Figure C. 1. However, 
as the problem grows, the MATRIX software can easily handle their solution. 
These procedures are demonstrated in the spreadsheet Example C-3. xls on the 
companion website for this book. 
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Example C.3 












Point 

X 

y 

Parameters 

0 

1 

2 

3 

Final 

1 

9.4 

5.6 


h 

7 

-0 28 

-7E-17 


6.7154 

2 

7.6 

7.2 


k 

4.5 

- 0.11 

5E-16 


4.3923 

3 

3.8 

4.8 


r 

3 

-0.07 

0015 


2.9438 
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Copy shaded area to MATRIX or solve In spreadsheet 

J 




Be sure to use a paste special/values. 

3 

3 
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0.885 
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Spreadsheet solution 

X 







-7E-17 

-2915 

0.408 

2 944 







-6E-16 

K 









-4E-05 

3 1 










0.000 










0 000 











0.000 


FIGURE C.l Spreadsheet for Example C.3. 


PROBLEMS 

C.l Solve for the unknowns x and y in the following nonlinear 
equations using Taylor’s theorem. (Use x 0 = 5 and y 0 = 5 for 
initial approximations). 

x 2 y - 3x 2 = 75 
x 2 -y= 19 

C.2 Solve for the unknown values of x, y, and z in the following three non¬ 
linear equations using the Taylor series. (Use x 0 = y 0 = z 0 = 2 for initial 
approximations.) 

x 2 - y 2 + 2 xy + z = 4 

—x + y + z = 4 
—lx 2 — y + z 2 = 23 

C.3 Use the MATRIX software to solve Problem C.l. 

C.4 Use the MATRIX software to solve Problem C.2. 

C.5 Find center and radius of a circle using the equation (x - h ) 2 + (y - k) 2 
= r 2 given the coordinates of points A, B. and C, on the circle. Follow 
the procedures discussed in Section C.5. Use initial approximations of 
h 0 = 5, k 0 = 4, and r 0 = 2 for the first iteration. 

A: (7.2, 5.2) B\ (4.0,6.4) C: (4.0,2.4) 
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C.6 Repeat Problem C.5 using the linear equation: x 2 + y 2 + 2dx + ley + 

/= o. 

C.7 Repeat Problem C.5 using the points A: (0.50, -0.70), B\ (1.00, 0.00), 
C: (0.70, 0.70). 

Use initial approximations of h () = 0 ,k 0 = 0, and r 0 = 1. 

C.8 Repeat Problem C.7 using the linear equation: x 2 + y 2 + 2 dx + ley + 

/= o. 

C.9 Use the ADJUST software to solve Problem C.5. 

C.10 Use the ADJUST software to solve Problem C.7. 

C.ll The distance formula between two stations i and j is 

D ij = \A*;-U) 2 + (Tj-U) 2 - 

Write the linearized form of this equation in terms of the variables x h 

y h x p and yj. 

C.12 The azimuth formula between two stations i and j is 



Write the linearized form of this equation in terms of the variables x r 

JU Xj, and y r 

C.13 The formula for an angle z.jik is a ik - ay, where a is defined in Problem 
C.12. Write the linearized form of this equation in terms of the variables 

Xj, yi, Xp y p x k , and y k . 

PROGRAMMING PROBLEMS 

C.14 Create a programmed package that solves Problem C.6. 

C.15 Create a programmed package that solves Problem C.5. 




APPENDIX D 


THE NORMAL ERROR 
DISTRIBUTION CURVE AND 
OTHER STATISTICAL TABLES 


D.1 DEVELOPMENT FOR NORMAL DISTRIBUTION 
CURVE EQUATION 

In Section 2.4, the histogram and frequency polygon were presented as 
methods for graphically portraying random error distributions. If a large num¬ 
ber of these distributions were examined for sets, observations in surveying, 
geodesy, and photogrammetry, it would be found that they conform to normal 
(or Gaussian) distributions. The general laws governing normal distributions 
are stated as follows: 

1. Positive and negative errors occur with equal probability and equal 
frequency. 

2. Small errors are more common than large errors. 

3. Large errors seldom occur, and there is a limit to the size of the greatest 
random error that will occur in any set of observations. 

A curve that conforms to these laws is plotted with the size of the error on the 
abscissa and probability of occurrence on the ordinate, appears as Figure 3.3. 
This curve is repeated on Figure D. 1 and is called the normal distribution curve, 
the normal curve of error, or simply the probability curve. A smooth curve of 
this same shape would be obtained if for a very large group of observations, 
a histogram were plotted with an infinitesimally small class interval. In this 
section, the equation for this curve is developed. 
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Error Size 


FIGURE D.l The normal distribution curve. 


Assume that the normal distribution curve is continuous and that the 
probability of an error occurring between x and x + dx is given by the function 
y = f{x). Further assume that this is the equation for the probability curve. 
The form of f(x) will now be determined. Since as explained in Chapter 3, 
probabilities are equivalent to areas under the probability curve, the prob¬ 
abilities of errors occurring within the ranges of {x x and x ] + dx i ), (x 2 and 
x 2 + dx 2 ), etc., are f{x\)dx \, f(x 2 )dx 2 ,... , f(x n )dx n . The total area under the 
probability curve represents the total probability or simply the integer one. 
Then for a finite number of possible errors: 


f(x l )dx l +f(x 2 )dx 2 + • • • +fix n )dx n = 1 


(D.l) 


If the total range of errors x ,, x 2 ,..., x n is between ±1, then considering an 
infinite number of errors that makes the curve continuous, the area under the 
curve can be set equal to: 



But because the area under the curve from +1 to +oo and from -1 to -oo is 
essentially zero, the integration limits are extended to ±oo, as 



(D.2) 


Now suppose that quantity M has been observed, and that it is equal to some 
function of n unknown parameters z l ,z 2 ,..., z n such that M= f{z x ,z 2 ,..., z n ). 
Also let .v|, x 2 ,..., x m be the errors of m observations M x , M 2 ,..., M ni and let 
/(a'|) dx\,f{x 2 ) dx 2 ,..., f{x m ) dx m be the probabilities of errors falling within 
the ranges of (xq and dx { ), (x 2 and dx 2 ), etc. By Equation (3.1) the probability 
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P of the simultaneous occurrence of all of these errors is equal to the product 
of the individual probabilities, thus 

P = If (.a: | )<r/jc | J L/ (x 2 )dx 2 \ ■ ■ ■ [f(x m )dx m \ 

Then by logs: 

LogP = log/fx,) + log/(x 2 ) + • • ■ + log/(x m ) + log dx x + log dx 2 

H-h log dx m (D.3) 

The most probable values of the errors will occur when P is maximized or 
when the log of P is maximized. To maximize a function, it is differentiated 
with respect to each unknown parameter z, and the results set equal to zero. 
After logarithmic differentiation of Equation (D.3) the following n equations 
result: (Note that dx’s are constants independent of the z’s and therefore their 
differentials with respect to the z’s are zero). 

1 dP _ 1 df(x x )dx x 1 df (x 2 ) dx 2 1 df(x m ) dx m _ ^ 

P dz x / (x |) dxi dz x f(x 2 ) dx 2 dz x f( x m ) dx m dz x 

1 dP _ 1 df{x x )dx x | 1 df(x 2 )dx 2 | | 1 df(x m )dx m 

P dz 2 f(x |) dx l dz 2 f(x 2 ) dx 2 dz 2 f( x m ) dx m dz 2 


I <)P _ 1 df(x l )dx l | 1 df(x 2 )dx 2 | | 1 df{x m )dx m _ Q 

Pdz„ /(V|) dx ] dz n f{x 2 ) dx 2 dz n f(x m ) dx m dz n 

(D.4) 


Now let 


ax 


Substituting Equation (D.5) into (D.4) gives 


f'(x l )dx l | f\x 2 )dx 2 | | f(x m )dx m 

f{X\)dz x f(x 2 )dz l f(x m )dz l 

f'(x x )dx i ^ f'(x 2 )dx 2 | | f(xjdx m 

f{X\)dz 2 f(x 2 )dz 2 f (x m )dz 2 


(D.5) 


f\x\)dx\ | f\x 2 )dx 2 | | f\x m )dx m 

f( x \)dz„ f(x 2 )dz n f (x m )dz n 
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Thus far /(x) and f'(x) are general, regardless of the number of unknown 
parameters. Now consider the special case where there is only one unknown z 
and Mi, M 2 , M m are m observed values of z. If z* is the true value of the 
quantity, the errors associated with the observations are 


x x = z* - Mi, x 2 = z* - M 2 , .. ■,x m = z* — M m (D.7) 

Differentiating Equation (D.7) with respect to z gives 

dx i dx 7 dx m 

1 = -7 1 = ~r = • • • = ~r (O-S) 

dz dz dz 

Then for this special case, substituting Equations (D.7) and (D.8) into 
Equations (D.6), they reduce to a single equation: 

/'(z* - Ml) f(z* -M 2 ) f{z* - MJ 

f(z* - M{) f(z* - M 2 ) f(z* - M m ) 

Equation (D.9) for this special case in consideration is also general for any 
value of m and for any observed values M x , M 2 ,..., M m . Thus, let the values 
of M be 

M 2 — M 2 = • • • = M m — Mi — mN 

where N is chosen for convenience as ,/V = (M x - M 2 )lm. 

The arithmetic mean is the most probable value for this case of a single quan¬ 
tity having been observed several times; therefore, z* the most probable value 
in this case is 


„* _ M x + M 2 -1-1 - M n 

m 

M x + (m - l)(Mj - mN) 
m 

= M x — mN + N 
= M x — N(m — 1) 

z* -Mi = -N(m - 1) = N( 1 - m) (D. 10) 

Recall that N = ( M x - M 2 )lm, from which M x = mN + M 2 . Substituting into 
Equation (D.10) gives 


z* — (inN + M 2 ) = N( 1 — m) 


z* - M 2 = N 
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Similarly, since N = (M l - M 3 )lm = (M ] - M A )lm and so on, 

z* - M 3 = N 
z* - M 4 =N 


Substituting these expressions into Equation (D.9) yields 


f'[n( 1 - m)] (m - \)f\N) 

flN( i - M)\ AN) 


Rearranging yields 


AN(l - in)] 

NAN (l — m)\(\ — m) 


AN) 

AN)N 


= constant 


because N in this case is a constant. Thus, 


fix) 

xf(x) 


= constant = K 


Substituting Equation (D.5) into Equation (D.12), yields 


>> r, \r d A*) 
/ (.x) = xf(x)K = —— 


(D. 11) 


(D.12) 


From which = xf(x)K. Integrating gives 


log J(x) = \kx 2 + C, 
Ax) = e c 'e Kxl l 2 


But letting 

e Ci = C 

Then 

f(x) = Ce {Kxl)/2 (D.13) 

In Equation (D.13), since f(x) decreases as x increases, and thus the expo¬ 
nent must be negative. Arbitrarily letting 


h = 



(D.14) 
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and incorporating the negative into Equation (D. 13), there results 

fix) = Ce~ hV (D.15) 


To find the value 
Equation (D.2) 


of the constant C, substitute Equation (D.15) into 



Ce~**dx = 1 


Also, arbitrarily set t = hx, then dt = hdx and dx = dtlh, from which, after 
changing variables, we obtain 


C 

h 



The value of the definite integral is \fn from which 1 




Substituting Equation (D.16) into Equation (D.15) gives 


fix) = 


Jt_ e -h 2 x 2 

yfn 


(D.16) 


(D.17) 


Note that from Equation (D. 14) that h = y/K/2. For the normal distribution 
K = \lo 2 . Substituting this into Equation (D.17) yields 


fix) = 


1 [l/2tT 2 ],Y 2 

\Jlo 2 Jt 


1 c-J/lo 2 

o\J1k 


(D.1S) 


where the terms are as defined for Equation (3.2). 

This is the general equation for the probability curve, having been derived 
in this instance from the consideration of a special case. In Table D.l which 
follows, values for areas under the standard normal distribution function from 
negative infinity to t are tabulated. 


1 The technique of integrating this nonelementary function is beyond the scope of this book but 
can be found in advanced references. 
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TABLE D.l Percentage Points for the Standard Normal Distribution Function 




0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

-3.2 

0.00069 

0.00066 

0.00064 

0.00062 

0.00060 

0.00058 

0.00056 

0.00054 

0.00052 

0.00050 

-3.1 

0.00097 

0.00094 

0.00090 

0.00087 

0.00084 

0.00082 

0.00079 

0.00076 

0.00074 

0.00071 

-3.0 

0.00135 

0.00131 

0.00126 

0.00122 

0.00118 

0.00114 

0.00111 

0.00107 

0.00104 

0.00100 

-2.9 

0.00187 

0.00181 

0.00175 

0.00169 

0.00164 

0.00159 

0.00154 

0.00149 

0.00144 

0.00139 

-2.8 

0.00256 

0.00248 

0.00240 

0.00233 

0.00226 

0.00219 

0.00212 

0.00205 

0.00199 

0.00193 

-2.7 

0.00347 

0.00336 

0.00326 

0.00317 

0.00307 

0.00298 

0.00289 

0.00280 

0.00272 

0.00264 

-2.6 

0.00466 

0.00453 

0.00440 

0.00427 

0.00415 

0.00402 

0.00391 

0.00379 

0.00368 

0.00357 

-2.5 

0.00621 

0.00604 

0.00587 

0.00570 

0.00554 

0.00539 

0.00523 

0.00508 

0.00494 

0.00480 

-2.4 

0.00820 

0.00798 

0.00776 

0.00755 

0.00734 

0.00714 

0.00695 

0.00676 

0.00657 

0.00639 

-2.3 

0.01072 

0.01044 

0.01017 

0.00990 

0.00964 

0.00939 

0.00914 

0.00889 

0.00866 

0.00842 

-2.2 

0.01390 

0.01355 

0.01321 

0.01287 

0.01255 

0.01222 

0.01191 

0.01160 

0.01130 

0.01101 

-2.1 

0.01786 

0.01743 

0.01700 

0.01659 

0.01618 

0.01578 

0.01539 

0.01500 

0.01463 

0.01426 

-2.0 

0.02275 

0.02222 

0.02169 

0.02118 

0.02068 

0.02018 

0.01970 

0.01923 

0.01876 

0.01831 

-1.9 

0.02872 

0.02807 

0.02743 

0.02680 

0.02619 

0.02559 

0.02500 

0.02442 

0.02385 

0.02330 

-1.8 

0.03593 

0.03515 

0.03438 

0.03362 

0.03288 

0.03216 

0.03144 

0.03074 

0.03005 

0.02938 

-1.7 

0.04457 

0.04363 

0.04272 

0.04182 

0.04093 

0.04006 

0.03920 

0.03836 

0.03754 

0.03673 

-1.6 

0.05480 

0.05370 

0.05262 

0.05155 

0.05050 

0.04947 

0.04846 

0.04746 

0.04648 

0.04551 

-1.5 

0.06681 

0.06552 

0.06426 

0.06301 

0.06178 

0.06057 

0.05938 

0.05821 

0.05705 

0.05592 

-1.4 

0.08076 

0.07927 

0.07780 

0.07636 

0.07493 

0.07353 

0.07215 

0.07078 

0.06944 

0.06811 

-1.3 

0.09680 

0.09510 

0.09342 

0.09176 

0.09012 

0.08851 

0.08691 

0.08534 

0.08379 

0.08226 

-1.2 

0.11507 

0.11314 

0.11123 

0.10935 

0.10749 

0.10565 

0.10383 

0.10204 

0.10027 

0.09853 

-1.1 

0.13567 

0.13350 

0.13136 

0.12924 

0.12714 

0.12507 

0.12302 

0.12100 

0.11900 

0.11702 

-1.0 

0.15866 

0.15625 

0.15386 

0.15151 

0.14917 

0.14686 

0.14457 

0.14231 

0.14007 

0.13786 

-0.9 

0.18406 

0.18141 

0.17879 

0.17619 

0.17361 

0.17106 

0.16853 

0.16602 

0.16354 

0.16109 

-0.8 

0.21186 

0.20897 

0.20611 

0.20327 

0.20045 

0.19766 

0.19489 

0.19215 

0.18943 

0.18673 

-0.7 

0.24196 

0.23885 

0.23576 

0.23270 

0.22965 

0.22663 

0.22363 

0.22065 

0.21770 

0.21476 

-0.6 

0.27425 

0.27093 

0.26763 

0.26435 

0.26109 

0.25785 

0.25463 

0.25143 

0.24825 

0.24510 

-0.5 

0.30854 

0.30503 

0.30153 

0.29806 

0.29460 

0.29116 

0.28774 

0.28434 

0.28096 

0.27760 

-0.4 

0.34458 

0.34090 

0.33724 

0.33360 

0.32997 

0.32636 

0.32276 

0.31918 

0.31561 

0.31207 

-0.3 

0.38209 

0.37828 

0.37448 

0.37070 

0.36693 

0.36317 

0.35942 

0.35569 

0.35197 

0.34827 

-0.2 

0.42074 

0.41683 

0.41294 

0.40905 

0.40517 

0.40129 

0.39743 

0.39358 

0.38974 

0.38591 

-0.1 

0.46017 

0.45620 

0.45224 

0.44828 

0.44433 

0.44038 

0.43644 

0.43251 

0.42858 

0.42465 

0.0 

0.50000 

0.49601 

0.49202 

0.48803 

0.48405 

0.48006 

0.47608 

0.47210 

0.46812 

0.46414 


( continues ) 
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TABLE D.l ( continued ) 




0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

0.0 

0.50000 

0.49601 

0.49202 

0.48803 

0.48405 

0.48006 

0.47608 

0.47210 

0.46812 

0.46414 

0.1 

0.53983 

0.53586 

0.53188 

0.52790 

0.52392 

0.51994 

0.51595 

0.51197 

0.50798 

0.50399 

0.2 

0.57926 

0.57535 

0.57142 

0.56749 

0.56356 

0.55962 

0.55567 

0.55172 

0.54776 

0.54380 

0.3 

0.61791 

0.61409 

0.61026 

0.60642 

0.60257 

0.59871 

0.59483 

0.59095 

0.58706 

0.58317 

0.4 

0.65542 

0.65173 

0.64803 

0.64431 

0.64058 

0.63683 

0.63307 

0.62930 

0.62552 

0.62172 

0.5 

0.69146 

0.68793 

0.68439 

0.68082 

0.67724 

0.67364 

0.67003 

0.66640 

0.66276 

0.65910 

0.6 

0.72575 

0.72240 

0.71904 

0.71566 

0.71226 

0.70884 

0.70540 

0.70194 

0.69847 

0.69497 

0.7 

0.75804 

0.75490 

0.75175 

0.74857 

0.74537 

0.74215 

0.73891 

0.73565 

0.73237 

0.72907 

0.8 

0.78814 

0.78524 

0.78230 

0.77935 

0.77637 

0.77337 

0.77035 

0.76730 

0.76424 

0.76115 

0.9 

0.81594 

0.81327 

0.81057 

0.80785 

0.80511 

0.80234 

0.79955 

0.79673 

0.79389 

0.79103 

1.0 

0.84134 

0.83891 

0.83646 

0.83398 

0.83147 

0.82894 

0.82639 

0.82381 

0.82121 

0.81859 

1.1 

0.86433 

0.86214 

0.85993 

0.85769 

0.85543 

0.85314 

0.85083 

0.84849 

0.84614 

0.84375 

1.2 

0.88493 

0.88298 

0.88100 

0.87900 

0.87698 

0.87493 

0.87286 

0.87076 

0.86864 

0.86650 

1.3 

0.90320 

0.90147 

0.89973 

0.89796 

0.89617 

0.89435 

0.89251 

0.89065 

0.88877 

0.88686 

1.4 

0.91924 

0.91774 

0.91621 

0.91466 

0.91309 

0.91149 

0.90988 

0.90824 

0.90658 

0.90490 

1.5 

0.93319 

0.93189 

0.93056 

0.92922 

0.92785 

0.92647 

0.92507 

0.92364 

0.92220 

0.92073 

1.6 

0.94520 

0.94408 

0.94295 

0.94179 

0.94062 

0.93943 

0.93822 

0.93699 

0.93574 

0.93448 

1.7 

0.95543 

0.95449 

0.95352 

0.95254 

0.95154 

0.95053 

0.94950 

0.94845 

0.94738 

0.94630 

1.8 

0.96407 

0.96327 

0.96246 

0.96164 

0.96080 

0.95994 

0.95907 

0.95818 

0.95728 

0.95637 

1.9 

0.97128 

0.97062 

0.96995 

0.96926 

0.96856 

0.96784 

0.96712 

0.96638 

0.96562 

0.96485 

2.0 

0.97725 

0.97670 

0.97615 

0.97558 

0.97500 

0.97441 

0.97381 

0.97320 

0.97257 

0.97193 

2.1 

0.98214 

0.98169 

0.98124 

0.98077 

0.98030 

0.97982 

0.97932 

0.97882 

0.97831 

0.97778 

2.2 

0.98610 

0.98574 

0.98537 

0.98500 

0.98461 

0.98422 

0.98382 

0.98341 

0.98300 

0.98257 

2.3 

0.98928 

0.98899 

0.98870 

0.98840 

0.98809 

0.98778 

0.98745 

0.98713 

0.98679 

0.98645 

2.4 

0.99180 

0.99158 

0.99134 

0.99111 

0.99086 

0.99061 

0.99036 

0.99010 

0.98983 

0.98956 

2.5 

0.99379 

0.99361 

0.99343 

0.99324 

0.99305 

0.99286 

0.99266 

0.99245 

0.99224 

0.99202 

2.6 

0.99534 

0.99520 

0.99506 

0.99492 

0.99477 

0.99461 

0.99446 

0.99430 

0.99413 

0.99396 

2.7 

0.99653 

0.99643 

0.99632 

0.99621 

0.99609 

0.99598 

0.99585 

0.99573 

0.99560 

0.99547 

2.8 

0.99744 

0.99736 

0.99728 

0.99720 

0.99711 

0.99702 

0.99693 

0.99683 

0.99674 

0.99664 

2.9 

0.99813 

0.99807 

0.99801 

0.99795 

0.99788 

0.99781 

0.99774 

0.99767 

0.99760 

0.99752 

3.0 

0.99865 

0.99861 

0.99856 

0.99851 

0.99846 

0.99841 

0.99836 

0.99831 

0.99825 

0.99819 

3.1 

0.99903 

0.99900 

0.99896 

0.99893 

0.99889 

0.99886 

0.99882 

0.99878 

0.99874 

0.99869 

3.2 

0.99931 

0.99929 

0.99926 

0.99924 

0.99921 

0.99918 

0.99916 

0.99913 

0.99910 

0.99906 
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D.2 OTHER STATISTICAL TABLES 

On the remaining pages of this chapter are three often-used statistical tables. 
Application of these tables and their interpretation are discussed in detail 
in Chapter 4. The equations used to generate each of these tables are also 
presented. 

D.2.1 The x 1 Distribution 

Chi-squared is a density function for the distribution of sample variances 
computed from sets with selected degrees of freedom for a population. The 
use of this distribution to construct confidence intervals for the population 
variance, and to perform hypothesis testing involving the population vari¬ 
ance are discussed in detail in Chapter 4. The / 2 distribution is illustrated 
Figure D.2. 

The x 2 distribution critical values given in Table D.2 were generated using 
the following function. (Critical x 2 values for both tails of the distribution were 
derived with a program using numerical integration routines similar to those 
used in STATS.) 



where v is the degrees of freedom, and T is known as the gamma function, which 
is defined as 



It is computed as T(v) = (v - 1)! = (v - l)(v - 2)(v - 3) • • • (3)(2)(1). 


f(u) 



U 


FIGURE D.2 x 2 distribution. 
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Ax) 



X 


FIGURE D.3 t distribution. 


D.2.2 t Distribution 

The t distribution function, shown in Figure D.3, is used to derive confidence 
intervals for the population mean when the sample set is small. It is also 
used in hypothesis testing to check the validity of a sample mean against a 
population mean. The uses for this distribution are discussed in greater detail 
in Chapter 4. 

The t distribution tables were generated using the following function. 
(Critical t values for the upper tail of the distribution were derived with a 
program using numerical integration routines similar to those available in 
STATS.) 



where T is the gamma function as defined in Section D.2.1, and v is the 
degrees of freedom in the function. In Table D.3 critical values of t are 
listed that are required to achieve the percentage points listed in the top row. 
The distribution is symmetrical, and thus 


F(-t) = 1 - F(t) 






TABLE D.3 Critical Values for the t Distribution 
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D.2.3 F Distribution (Also known as Fisher distribution ) 

This F distribution function, shown in Figure D.4, is used to derive confidence 
intervals for the ratio of two population variances. It is also used in hypoth¬ 
esis testing for this same ratio. The uses for this distribution are discussed in 
Chapter 4. 

Critical F values for the upper tail of the distribution were derived with a 
program using numerical integration routines similar to those used in STATS. 
The tables were generated using the following function. 



where T is the gamma function as defined in Section D.2.1, v, the numerator 
degrees of freedom, and v 2 the denominator degrees of freedom. 

For critical values in the lower tail of the distribution, the following relation¬ 
ship can be used in conjunction with the tabular values given in the following 
pages: 
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FIGURE D.4 F distribution. 
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APPENDIX E 


CONFIDENCE INTERVALS FOR THE 
MEAN 


Table E.l represents 1000 95% confidence intervals constructed from sample 
sets selected from a population with a mean (/r) of 25.4 and a variance (a 2 ) of 
1.69. These data are discussed in Chapter 4. (Note: Intervals with asterisks fail 
to include /<.) 


Adjustment Computations: Spatial Data Analysis, Sixth Edition. Charles D. Ghilani. 
© 2018 by John Wiley & Sons, Inc. Published 2018 by John Wiley & Sons, Inc. 
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TABLE E.l 1000 95% Confidence Intervals 
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(25.08,26.29) (24.60,26.08) (25.24,26.50) (24.79,26.10) (25.17,26.53) (24.85,25.88) (24.79,26.18) (24.64,26.11) 

(24.52,25.99) (24.89,26.14) (24.29,25.84) (24.68,25.99) (24.41,26.17) (25.18,26.57) (24.10,25.54) (25.23,26.47) 

(24.97,26.44) (24.59,25.63) (24.80,26.00) (24.91,26.29) (24.56,25.92) (24.65,26.02) (24.34,25.42) (24.86,26.32) 

(24.54,25.79) (25.13,26.68) (24.60,25.78) (24.49,25.87) (24.94,26.19) (25.13,26.39) (24.47,25.60) (24.61,25.77) 



(24.74,26.67) (25.03,26.54) (24.69,26.59) (24.84,26.37) (24.81,26.35) (24.64,25.95) (24.89,26.07) (24.50,25.91) 

(24.34,25.83) (25.10,26.12) (24.87,26.48) (25.00,26.54) (24.64,26.00) (24.71,26.09) (24.43,26.05) (24.54,25.69) 

(24.37,25.61) (24.49,25.97) (24.48,25.60) (24.65,26.73) (25.18,26.41) (25.09,26.44) (24.95,26.40) (24.64,26.01) 

(24.58,25.81) (24.47,25.66) (24.39,25.72) (24.12,25.71) (24.58,25.85) (25.77,27.28)* (24.67,25.86) (24.78,26.43) 
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APPENDIX F 


MAP PROJECTION COORDINATE 
SYSTEMS 


F.1 INTRODUCTION 

Most local surveyors are well-served by using map projections such as the State 
Plane Coordinate System. These two-dimensional grid systems allow survey¬ 
ors to perform accurate computations over large regions of land using plane 
surveying computations. They are the basis for the adjustments discussed in 
Chapters 14 through 16. 

Map projections provide a 1 -to-1 mathematical relationship with points on 
the ellipsoid and those on the mapping surface. There are an infinite number of 
map projections. Most map projections are defined by a series of mathematical 
transformations used to convert a point’s geodetic coordinates of latitude, 4>, 
and longitude, A, to NE (y, x) grid coordinates. Some map projections preserve 
the shape of objects (conformal), others areas, directions, or distances of lines. 
However since the Earth is ellipsoidal in shape and a mapping surface is a 
plane, all map projections introduce some form of distortion to observations. 
For example, distances and areas are distorted in a conformal map projection. 

Often, to reduce the size of these distortions, the developable surface is made 
secant to the ellipsoid and the width of the mapping zone is limited in dis¬ 
tance. For instance, when the National Geodetic Survey originally designed the 
state plane coordinate system during the 1930s, the zone widths were limited 
to 158 mi so that precision between the ellipsoid distance and the grid distance 
were no worse than 1:10,000. Since most surveys, at that time, were only accu¬ 
rate to a precision of 1:5000, this was an acceptable limit. However, with today’s 
modern instruments, proper reduction of observations must be performed if the 
accuracy of the surveys is to be preserved in a map projection system. 
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All map projections are based on a selected ellipsoid such as the Geodetic 
Reference System of 1980 (GRS 80) and defining zone parameters. Typically, 
the zone parameters define the grid origin ($ 0 , A 0 ), secant lines of the pro¬ 
jection, also known as standard parallels, or scale factor, k 0 , at the central 
meridian, T 0 , and the offset distances (E 0 , N b ) from the grid origin. Once 
defined, each map projection has a series of zone constants that are computed 
using the defining zone parameters. These zone constants are computed only 
once for each projection. Following this, the direct and inverse problems 
can be performed for any point in the system. The direct problem takes the 
geodetic coordinates of a point and transforms them into grid coordinates, 
and the inverse problem takes the grid coordinates of a point and transforms 
them into geodetic coordinates. 

The two primary map projection systems used in the United States are 
the Lambert Conformal Conic for states having long east-west extents and 
the Transverse Mercator for states having long north-south extents. Both 
map projections are conformal. That is, they preserve angles in infinitesimally 
small regions about a point. This property is advantageous to surveyors 
since angles are minimally distorted when using a conformal projection. 
On the other hand, as shown in Figure F.l, observed horizontal distances 
must be reduced to the mapping surface to eliminate the distortions in the 
projection. Flowever, if these reductions are performed properly, the resulting 
plane computations are as accurate as geodetic computations such as those 
presented in Chapter 23. This Appendix will look at the mathematics of the 
Lambert Conformal Conic, Transverse Mercator, and oblique stereographic 
map projections and demonstrate proper methods in reducing observations 
before an adjustment. 



FIGURE F.l Reduction of a distance to a mapping surface. 
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F.2 MATHEMATICS OF THE LAMBERT CONFORMAL 
CONIC MAP PROJECTION 

The Lambert Conformal Conic map projection was first introduced by Johann 
Lambert in 1772. As its name implies, this map projection uses a cone as its 
developable surface. The projection is conformal so that angles are preserved 
in a limited region about a point, but distances are distorted. A Lambert Con¬ 
formal Conic map projection is defined by two ellipsoidal parameters, 1 grid 
origin ( cp 0 , A 0 ), latitude of the north standard parallel, <p N , and south standard 
parallel, 2 cp s , false easting, E 0 and false northing, N h . 


F.2.1 Zone Constants 

Three functions are used repeatedly in the computations of the Lambert 
Conformal Conic map projection: 


W((p) = yj 1 — e 2 sm 2 (p 
cos 4> 


M(0) 


T(<f>) 


W(4>) 


sin (p \ ( 1 + e sin $ 


1 + sin 4> J \ 1 — e sin 


(F.l) 

(F2) 

(F.3) 


Using Equations (F.l) through (F.3), the remaining zone constants are 
defined as 


vi-’i = W(4> s ) 

(F.4) 

w 2 = W(<p N ) 

(F.5) 

777 j = M(<p s ) 

(F.6) 

m 2 = M(cfr N ) 

(F.7) 
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II 

o 

(F.8) 

^5) 

E-i 

II 

(F.9) 

kT" 

ii 

tL 

(F.10) 


'Typically, an ellipsoid is defined by the length of its semi-major axis, a , and it flattening factor,/ 
The first eccentricity is computed as e = y/2f —f 1 . The GRS 80 ellipsoid has defining parameters 
of a = 6,378,137.0 m and/= 1/298.257222101.' 

2 The standard parallels are the latitudes of the north and south secant lines for the cone on the 
ellipsoid. 
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n = sin (p o 


I :i m [ — In m 2 
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R h = aFt n {) - radius of the projection 


(F. 11) 
(F. 12) 
(F. 13) 


F.2.2 Direct Problem 

The direct problem takes the geodetic coordinates of latitude, 4>, and longitude, 
A, of a point and transforms them into xy grid coordinates. Often, the y coordi¬ 
nate is called the point’s northing, N, and the x coordinate its easting, E. Thus, 
given the geodetic coordinates of a point, the northing (y), easting (x), scale 
factor, k, and convergence angle, /, of the point are computed as 


t = T(</>) 
m = M(cp) 

R = aFf 

y = (X - X 0 )n (where western longitude is considered negative) 
E — R sin y + E 0 
N = R b - R cos y + N h 

k — n 
am 


(F. 14) 
(F.l 5) 
(F.l 6) 
(F.17) 
(FI 8) 
(F.l 9) 

(F.20) 


F.2.3 Inverse Problem 

The inverse problem takes a point’s northing and easting coordinates and 
computes its latitude, longitude, scale factor, and convergence angle. For 
the Lambert Conformal Conic map projection, the equations for the inverse 
problem are 


tq 

1 

II 

tq 

(F.21) 

N' = R h — (N - N h ) 

(F.22) 

R = sJe ' 1 + N' 2 

(F.23) 

II 

(F.24) 

r = tan_ 1 (f) 

(F.25) 

X = 90° - tan -1 / 

(F.26) 
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(F.27) 


Repeat Equation (F.27) using / for cp in the first iteration. Iterate until the 
change is cp is insignificant; that is, the change should be less than 0.000005". 



(F.28) 


(F.29) 


where m and t are defined in Equations (F.14) and (F.15) using (p from 
Equation (F.27). 

The Mathcad® worksheet Lambert, xmcd on the companion website demon¬ 
strates both the direct and inverse problems using the Lambert Conformal 
Conic map projection. 


F.3 MATHEMATICS FROM THE TRANSVERSE MERCATOR 

The Transverse Mercator map projection uses a cylinder as its developable 
surface. It preserves scale in a north-south direction, and thus is good for 
regions with long north-south extent. This projection was originally proposed 
by Johann Lambert, but the mathematics for the ellipsoid were not solved 
until the early twentieth century. In many countries, this projection is also 
known as the Gauss-Kriiger map projection. The most well-known Transverse 
Mercator map projection is the Universal Transverse Mercator (UTM), which 
was developed by the National Geospatial-Information Agency to provide a 
worldwide mapping system from 80° S latitude to 80° north latitude. This map 
projection is defined by two ellipsoidal parameters, 3 grid origin ( cp Q , A 0 ), scale 
factor, k 0 , at the central meridian, A 0 , false easting, E 0 and false northing, N h . 

There are 60 zones in the Universal Transverse Mercator map projection, 
with each being nominally 6° wide. Each zone overlaps its neighboring zones 
by 30'. The central meridian, A 0 , for each zone is assigned a false easting, E 0 , 
of 500,000 m. The false northing, N b , in the northern hemisphere of 0.000 m 
and is 10,000,000.000 m in the southern hemisphere. The scale factor at the 
central meridian, k 0 , is 0.9996, which yields a distance precision of 1:2500. The 
central meridians (2 0 ) for each zone start at 177° W longitude and with a few 
exceptions proceeds easterly by 6° for each subsequent zone. The grid origins 
are at 0° and A 0 . 


3 The Universal Transverse Mercator (UTM) uses the WGS 84 ellipsoid defined previously in 
Chapter 17. 
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F.3.1 Zone Constants 

The Transverse Mercator map projection uses the following defining functions 

C(<p) = e' 2 cos 2 (p (F.30) 

T(cp) = tan cp (F.31) 


M(4>) = a 


. e 2 3e 4 5e 6 \ , ( 3e 2 3e 4 45e 6 \ . - , 

4 64 256 J v \ 8 32 1024/ 
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15e 4 , 45e 6 \ . 


-1-) sin 4<p — I - I sin 6 d> 

256 1024/ v \ 3072 / v 


35e 6 


(F.32) 


where e is the first eccentricity of the ellipse as defined in Equation (17.5) and 
e' is defined as 


b = a{ 1 -/) 

, Vo 2 - b 2 

S ~ b 
m 0 = M{(p 0 ) 


(F.33) 

(F34) 


F.3.2 Direct Problem 

The equations in the Transverse Mercator for the direct problem are 
m = M(cp) (F.35) 

t = T(4>) (F.36) 

c = C(4>) (F.37) 

A = (k - X 0 ) cos 4 >, where western longitudes are negative (F.38) 

A 3 . ( r m l2\ A 5 


E = k 0 R 


N 


A + (\ -t + c)^L + (5- 18t + i 2 + 72c-58e /2 ) 

o \ / 120 


+ 'fi'o 


N = k 0 < 


m — m 0 + R n tan cp 


A 2 , c n 2 \ A 4 

— + (5 - t + 9c + 4c 2 ) — 

2 v ; 24 

+ (61 - 58/ + t 2 + 600c - 330e /2 ) 


A 6 

720 


(F.39) 


+ N h 


(F.40) 

where /^ v is the radius in the prime vertical as defined by N in Equation (17.6). 

„ _ 1 + 3c + 2c 2 2 - tan 2 /; 

2 3 C3_ 15 

y = A tan cp [l + A 2 (c 2 + c 3 A 2 )) 


(F.41) 
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l+(l + c)y 

° +(5-4? + 42c+ 13c 2 -23e' 2 ) ^ 


+ (61 - 148/ + 16/ 2 ) 


A 6 
720 . 
(F.42) 


F.3.3 Inverse Problem 

The equations in the Transverse Mercator for the inverse problem are 


E' 
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N' =N -N h 
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The so-called foot-point latitude is 


<Pf = X + 
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(F.43) 

(F.44) 

(F.45) 

(F.46) 

(F47) 


(F.48) 


Using the foot-point latitude and functions defined in Section F.3.1 and 
Equation (17.5): 


C(cP f ) 

T(4> f ) 
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(F50) 

(F.51) 
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b = y ~( 5 + 3f 1 + 10 Cl -4 C 2-9O^ 

+ (61 + 90?! + 298cj + 454 1\ - 252e' - 3c\) ^L 


0 = </>/■- 


TVj tan</y\ 
-— 1 B 

Mi ) 


(F.54) 

(F.55) 


An + 


D - (1 - 2?! + Cl ) ^ + (5 -2 Cl + 28?! - 3q + 8e' 2 + 24/f) ^ 


cos 


0/ 


(F.56) 


Note that Equations (F.41) and (F.42) can be used to compute the con¬ 
vergence angle y and scale factor k for the point. The Mathcad® worksheet 
TM.xmcd on the companion website demonstrates both the direct and inverse 
problems using the Lambert Conformal Conic map projection. 


F.4 STEREOGRAPHIC MAP PROJECTION 


As discussed in Section 24.5, the oblique stereographic map projection is often 
used as a temporal coordinate system when transforming GNSS coordinates 
into some local or arbitrary coordinate system. The stereographic map pro¬ 
jection uses a plane as its developable surface. Its definition only requires the 
geodetic coordinates of the origin and the scale factor at the origin. As dis¬ 
cussed in Section 24.5, a scale factor is often chosen so that the map projection 
plane is at the elevation of the project, thus placing grid distances at grade 
and eliminating the need to perform reduction of observations as discussed in 
Section F.5. 

As previously stated, an individual map projection coordinate system is 
defined by its grid origin ( cp 0 , 2 0 ) and scale factor k 0 . It uses the common 
functions: 


X(<P) = 2 tan 1 


tan| 4 + 2 


(p \ ( \ — e sin cj) 
1 + e sin 4> 


M(4>) = 


cos (p 




e 2 sin 2 cp 


n 

2 


(F.57) 

(F.58) 


where e is the eccentricity of the defining ellipsoid as given in Equation (17.5). 
Using these equations, the zone constants for the projection are 


To = T(0o) 
m 0 = m(x o) 


(F.59) 

(F.60) 
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Using the geodetic coordinates of (cp, A) for a point and the semimajor axis 
a for the ellipsoid, the equations for the direct problem are 


T = x(4>) (F.61) 

m = m((j>) (F.62) 

A = - - - Tfktfn* --- (F.63) 

cos Xo [1 + sin Xo sin x + cos Xo cos / cos(A - A 0 )J 

E = A cos x sin (A - A 0 ) (F.64) 

N — A [cos Xo sin X ~ sin Xo cos X cos (A - A 0 )] (F.65) 

k = ESii (F.66) 

am 


The inverse problem converts the map projection coordinates of (N, E) back 
to geodetic latitude and longitude. This conversion is not necessary for use in 
Section 24.5 since the goal of the problem is to convert the geodetic coordinates 
into an arbitrary or local coordinate system. Flowever, by inversing the process, 
the geodetic coordinates of any point in the local coordinate system can be 
found. The equations used in the inverse problem for the oblique stereographic 
map projection are 


p= \Je 2 + N 2 


(F.67) 
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(F.68) 

(F.69) 

(F.70) 

(F.71) 


Using (p equal to / in the first iteration. Equation (F.71) is iterated until 
the change in cp becomes negligible. The scale factor is computed using 
Equation (F.66). Computations for the oblique stereographic map projection 
are demonstrated in the Mathcad® worksheets C24-2.xmcd and ostereo.xmcd 
on the companion website. 


F.5 REDUCTION OF OBSERVATIONS 

Most often, the grid coordinates of a point are known prior to the survey and 
all that is needed is to reduce the observations to the mapping surface. The 
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basic principle to bear in mind is that grid computations should only be per¬ 
formed with grid observations. Since the map projections discussed previously 
are conformal, observed distances must be reduced to the mapping surface to 
preserve then accuracy of the survey. Additionally, geodetic and astronomical 
directions must be converted to their grid equivalents. 

As will be discussed in this section, conformality implies that the angles will 
be only slightly distorted. As will be shown, the so-called arc-to-chord correc¬ 
tion is applied when the sight distances are long. For example in the State Plane 
Coordinate System, the NGS recommended this correction for angles having 
sight distances that are greater than 8 km. In this section, the proper reduction 
of distance, direction, and angle observations will be discussed. 


F.5.1 Reduction of Distances 


As shown in Figure F.l, an observed horizontal distance must be reduced to the 
mapping surface. This reduction usually involves using the so-called combined 
factor. The combined factor is the product of the elevation factor that reduces 
the observed distance to the ellipsoid and a scale factor ( k ), which reduces the 
ellipsoidal distance to the mapping surface. 

There are several procedures for reducing an observed distance to the 
ellipsoid, with the most precise being a geodetic reduction. Flowever, sur¬ 
veyed lengths contain only five or six significant figures, typically. Thus, less 
strict methods can be applied to these short lengths. The elevation factor is 
computed as 

R R 

EF = -A—_ = _A_ (F.72) 


R.. + H + N R„ + h 


In Equation (F.72), R e is the radius of the Earth, H the orthometric height, 
N the geoidal height, and h the geodetic height. All of these parameters are 
determined at the observation station. The relationship between the geodetic 
height, h, and orthometric height H is 


h = H + N (F.73) 

In Equation (F.73), the radius in the azimuth of the line should be used for 
R e . Again since surveyors observe short distances typically, an average radius 
of the Earth of 6,371,000 m can be used in computing elevation factor. These 
approximations will be demonstrated in Example F. 1. 

In a map projection system, the scale factor computed using Equations 
(F.20), (F.29), or (F.42) is for a point. Generally, the scale factor changes 
continuously along the length of the line. Thus, a weighted mean using two 
endpoints of the line ( k x and k 2 ) and midpoint (k m ) is a logical choice for 
computing a single scale factor for a line. It can be computed as 
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However, as with the elevation factor, this type of precision is seldom needed 
for the typical survey. Thus, the mean of the two endpoint scale factors is gen¬ 
erally of sufficient accuracy for most surveys. In fact, it is not uncommon to 
use a single mean scale factor for an entire project. 

As previously stated, the combined factor, CF, for the line is a product of 
the elevation factor ( EF ) and scale factor (k avg ) and is computed as 

CF = k avg (EF) (F.75) 

Thus, a reduced grid distance, L Grid , is the product of the horizontal distance 
L m and combined factor, CF , and is computed as 

L G n d = LJCF) (F.76) 

Example F.l A distance of 536.07 ft is observed from Station 1. The 
scale factors at observing, midpoint, and sighted stations are 0.9999587785, 
0.9999587556, and 0.9999587328, respectively. The orthometric height at 
observing station is 1236.45 ft. Its geoidal height is -30.12 m and the radius 
in the azimuth is 6,366,977.077 m. Determine the length of the line on the 
mapping surface. 

SOLUTION This solution will compare the combined factor computed 
using different radii in Equation (F.57) and different scale factors in 
Equation (F.60). Using the more precise methods, the combined factor is 
computed as follows. The orthometric height of the observing station in 
meters is 

H= 1236.45 ft( 12/39.37) = 376.871m 

Using the radius in the azimuth of the line and Equation (F.57), the elevation 
factor, EF , is 


EF = 


6,366,977.077 


6,366,977.077 + 376.871 - 30.12 
From Equation (F.74), the scale factor for the lines is 


= 0.999945542 


k-avg 


0.9999587785 + 4(0.9999587556) + 0.9999587328 
6 


= 0.999958756 


From Equation (F.75), the combined factor for the line is 

CF = 0.999945542(0.999958756) = 0.99990430 
Finally, the grid distance for this line is 

L Grid = 0.99990430(536.07 ft) = 536.02 ft 
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Doing the problem again, but this time with the mean radius of the Earth and 
the average of the two-endpoint scale factors yields 


EF = 


6, 371,000 


k 

avg 


6, 371,000 + 376.871 - 30.12 
0.9999587785 + 0.9999587328 


0.999945577 


0.999958756 


CF = 0.999945577(0.999958756) = 0.99990433 


L Grid = 0.99990433(536.07 ft) = 536.02ft 


Note that using the approximate radius of the Earth and the average scale fac¬ 
tor for the endpoints of the line resulted in the same solution as the more precise 
computations. This is because the length of the observed distance has only five 
significant figures. The elevation factor computed using the mean radius of the 
Earth agreed with the radius in the azimuth to seven decimal places. This is 
also true of the scale factors, which agreed to nine significant figures. Thus, the 
combined factor was the same to seven decimal places and was well beyond 
the accuracy needed to convert a length with only five significant figures. This 
demonstrates why a common combined factor can many times be used for an 
entire project that covers a small region. 


F.5.2 Reduction of Geodetic Azimuths 

Figure F.2 depicts the differences between geodetic azimuths, T, and grid 
azimuths, t. Since grid north ( GN) at a point is parallel to the central meridian, 
the convergence angle, y, is the largest correction between the two geodetic 
and grid azimuths. Additionally, there is a small correction to convert the 
arc on an ellipsoid to its equivalent chord on the mapping surface. This is 
known as the arc-to-chord correction 5. The relationship between the geodetic 
azimuth and grid azimuth can be derived from Figure F.2 as 

T = t + y - 5 (F.77) 

As shown in Figure F.2, this equation works whether the line is east or west 
of the central meridian. For the Lambert Conformal Conic map projection, the 
arc-to-chord correction is computed as 

<5 = 0.5(sin 0 3 - sin d> 0 )(2 2 - 2j) (F.78) 

An analysis of Equation (F.78) shows that the worst cases for 5 are for 
lines in the northern or southern extent of a map projection. Rearranging 
Equation (F.78) yields a change in longitude is 

25 

(sin </) 3 - sin 0 O ) 


Xn — — A2 — 


(F.79) 
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N 



FIGURE F.2 Relationship of geodetic azimuth (T), grid azimuth (?), convergence 
angle (/), and arc-to-chord correction (6). 


As an example, assume </> 3 is 42° 30'. Furthermore, assume that the project 
is in the Pennsylvania North Zone, which has a sin (p 0 of 0.661539733812. If 8 
is to be kept below 0.5", then the maximum line in arc-seconds of longitude 
can be 


Ad = 


2(0.5") 


(sin42°30' -0.661539733812) 


= 71.2" 


At latitude 42°30', this corresponds to a line of length of about 5334 ft or 
1.6 km. Few surveyors in Northeastern Pennsylvania could find a line of this 
length to observe. Thus, the arc-to-chord correction is generally ignored in 
reductions, and Equation (F.77) can be simplified as 


T = t+y 


(F.80) 






APPENDIX G 


COMPANION WEBSITE 


G.1 INTRODUCTION 

The book’s companion website has several programs and instructional work¬ 
sheets to aid the student in the learning process. The companion website con¬ 
tains the software ADJUST, MATRIX, and STATS that were available with 
the previous edition of the book. Additionally, Mathcad® worksheets demon¬ 
strate the programming of many of the problems presented in this book. For 
those who do not own Mathcad, html hies of these worksheets have been cre¬ 
ated. These hies can be viewed using your computer’s web browser. Microsoft 
Excel® spreadsheets on the companion website demonstrate the solutions to 
many of the example problems presented in this book. 

All of the software contained on the companion website is Windows-based 
and will run on most Windows-based computers. Each program has its own 
installation program in the zip hie on the companion website. Each program 
has different system memory requirements; although all will run on less than 
2 megabytes of memory. The Mathcad worksheets and Excel spreadsheets can 
be individually copied to your machine. The Mathcad e-book will be available 
in Mathcad help system if the entire e-book subdirectory is copied to a similar 
subdirectory under the Mathcad handbook subdirectory. 

This software is “freeware” and as such can be freely distributed with this 
book. However, it is not intended for commercial use, not guaranteed to be 
computationally correct, nor supported in any manner. It is simply provided 
to aid your understanding of the topics contained in this book. 
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G.2 FILE FORMATS AND MEMORY MATTERS 

Most options in the software packages ADJUST, MATRIX, and STATS use 
formatted text files for data entry. Each package is equipped with an editor that 
allows the user to create these files. The help file for each software program 
describes the format of the data files. Many of these files have been described 
throughout the book. It is also possible to create data files using other text 
file editors such as Notepad. The file-reading routines contained in ADJUST, 
MATRIX, and STATS can use either commas, spaces, or tabs as delimiters 
between fields. It is therefore important to avoid commas in large numbers such 
as coordinates, since the software will read each part of the number individu¬ 
ally. For example, a coordinate of 675,301.213 will be read as the numbers 675 
and 301.213, since the comma is a delimiter. The use of the TAB delimiter is 
especially useful with MATRIX, since this allows the user to “cut and paste” 
values from spreadsheets. Furthermore, station and point identifiers should not 
contain any delimiter characters. Thus, a station called BM RED must not be 
entered with a space or it will be interpreted as BM and RED. For example, it 
could be entered as BM_RED. 

Starting with Version 4.0, ADJUST has used dynamic memory allocation. 
That is, data storage structures are not created until their sizes have been 
defined at runtime. Therefore, users familiar with earlier versions of ADJUST 
should be aware that some file formats have changed to accommodate this 
programming change. As a user, this feature means that the size limits of 
data types in various options in the software are now only limited by your 
computer’s memory resources. Thus, much larger problems can be handled 
with this software. Additionally, version 7.0 provides the radial errors for 
stations in both the horizontal and vertical least squares adjustments as was 
discussed in Chapter 19. 


G.3 SOFTWARE 
G.3.1 ADJUST 

ADJUST is the main computational program. It contains programs that either 
support computation of problems in the book or perform the computations. 
There are several least squares programs contained in ADJUST and several 
supporting options. A list of the least squares options and supporting software 
contained in ADJUST is shown in Table G.l. For example, the traverse option 
in ADJUST can compute initial approximations for unknown stations in a 
horizontal plane survey. The “Horizontal Data” under Least Squares Adjust¬ 
ments can perform the least squares adjustment of the data, as discussed in 
Chapters 14 through 16. 

File formats required by this software are discussed in the accompanying 
Help file. There are files available for copying or browsing that are bundled with 
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TABLE G.l Brief Summary of Software Options Contained in ADJUST 


Option 

Data File Required 

Least Squares 
Adjustment 

Astronomical Observations 

Reduction for Azimuth 

Yes 

No 

Prediction of Position 

No 

No 

Coordinate Computations 

Forward 

No 

No 

Inverse 

No 

No 

Traverse 

Yes 

No 

Check Traverse Closure 

Yes 

No 

Area 

Yes 

No 

State Plane Coordinates 

Dependent on option 

No 

Universal Transverse Mercator 

Dependent on option 

No 

Coordinate Geometry 

No 

No 

Geocentric Coordinates 

No 

No 


Dependent on option 

No 

Oblique Triangle Solutions 

No 

No 

Geodetic Computations 

Forward Computations 

No 

No 

Inverse Computations 

No 

No 

Helmert Transformation 

Yes 

Yes 

Localization 

Yes 

Yes 

Distance Reduction 

No 

No 

Radii 

No 

No 

Coordinate Transformations 

2D Conformal 

Yes 

Yes 

2D Affine 

Yes 

Yes 

2D Projective 

Yes 

Yes 

3D Conformal and Affine 

Yes 

Yes 

Estimated Errors 

Horizontal/Plane Data 

Yes 

No 

Differential Leveling 

Yes 

No 

Check Errors 

Yes 

No 

Fit of Points 

Line 

Yes 

Yes 

Circle 

Yes 

Yes 

Parabola 

Yes 

Yes 

GNSS Data 

Loop Closure Check 

Yes 

No 

Baseline Vector Adjustment 

Yes 

Yes 

Simulated Adjustment 

Yes 

Yes 


(i continues ) 
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TABLE G.l ( continued ) 


Option 

Data File Required 

Least Squares 
Adjustment 

Least Squares Adjustments 
Differential Leveling Data 

Yes 

Yes 

Horizontal Data 

Yes 

Yes 

3D Geodetic Network 

Yes 

Yes 

Simulated Adjustments 

Yes 

Yes 


the software. Along with the Help hies, these sample data hies can be viewed 
and compared with the accompanying example problem in the book to assist 
you in creating your own hies. 

G.3.2 STATS 

STATS is a statistical package that computes the basic statistical properties 
of simple data sets as well as derives the critical values for the normal, t, x 2 , 

F, and r distributions. It can also develop conhdence intervals for the three 
distributions and performs hypothesis testing for the t, x 2 , and F distributions. 

G. 3.3 MATRIX 

MATRIX performs simple matrix operations. This software can be used to 
solve many of the least squares problems presented in this book. It can read 
and write hies of matrices, perform the operations of scaling, transposition, 
addition, subtraction, multiplication, and inversing of matrices, and allow the 
user to view the results of these operations. 

When solving least squares problems with this package, a spreadsheet can 
be used to compute the matrices for the problem. These matrices can then be 
cut and pasted into the MATRIX editor. Once saved to disk, the data hies can 
be read by the software and manipulated. 

G.3.4 Mathcad Worksheets 

The companion website contains an electronic Mathcad book. This book 
should be copied to a subdirectory in the HANDBOOK directory under 
Mathcad so that the electronic book can be opened from the Mathcad 
Help Menu. 

The worksheets demonstrate most of the numerical examples contained 
in this book. Most can be modified to compute other problems in the book. 
Some of the worksheets read data hies. These hies can be created by any text 
editor such as those contained in ADJUST, MATRIX, and STATS, or by 
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another package such as Notepad. With many spreadsheets, it is possible 
to save a comma-separated values (.csv) text hie. The format of the hie is 
demonstrated by the numerical example problem being solved in the original 
worksheet. Thus, when the original worksheet is modified, it should be saved 
with a different name. You should compare the hie formats in these worksheets 
with the example problem listed in book to determine the proper format for 
your data. 

These worksheets also provide a guide as to how various problems are 
solved using programming. The Mathcad language is very similar to tra¬ 
ditional higher-level programming languages. However, Mathcad does not 
provide global variables. Thus, all variables, especially those that will be 
modihed, must be passed from function to function in a worksheet and 
between worksheets. Mathcad reads the executable commands and variables 
from the top to the bottom of the worksheet and from left to right on a line. 
This means that location of a command or variable on the worksheet can be 
critical to the worksheet performing properly. Another difference between a 
traditional programming language and Mathcad is that Mathcad has both 
subscripted variables and array elements. Unfortunately, while the subscript 
and array element are entered differently, they look visually the same on the 
worksheet. Thus, it is easy to confuse a subscripted variable with a matrix 
element. That is, a 0 may look like a reference to a matrix element when in 
fact it is a subscripted variable. The user should refer to the Mathcad help 
system to learn how to distinguish between, and use, subscripted variables 
and matrix elements. The Mathcad code in Figure G.l depicts references to 
matrix elements. 

Figure G.l contains a function to compute the azimuth of a line based on 
the coordinates of the endpoints. Except for the slight language-specific differ¬ 
ences, the code in the Mathcad and C functions is very similar. Thus, with some 
modifications, the code in the Mathcad worksheets can serve as a model when 
developing similar code in a traditional programming language. 


Mathcad Azimuth Computation 
Function: 


C Language Azimuth Computation 
Function: 


Az(crds.i.j) 


dx - crdsj, - crds u 
dx - crd^ j - crds, t 
a - atan2(dy, dx) 
a - a + 2'Jt if a < 0 
return a 


double azfcrdstruct crds[ 10], int i. int j) 

{ 

double dx, dy, alpha: 

dx = crds[j][l] - crds[i][l]; 

dy = crds[j][2] - crds[i][2]; 

alpha = atan2(dy,dx); 

if (alpha<0) alpha = alpha + 2*PI(); 

return alpha; 


FIGURE G.l Comparison of a Mathcad function and a C function. 
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G.3.5 Spreadsheets 

Several times in the book, spreadsheets are discussed as an aid in analyzing 
data. Samples of Excel® spreadsheets are available on the companion web¬ 
site. These spreadsheets can be viewed and analyzed as appropriate. These 
spreadsheets demonstrate much of the computational power that is available 
in a spreadsheet. Additionally the statistical tables from Appendix D are also 
available for use from a spreadsheet called tables.xls. 


G.4 USING THE SOFTWARE AS AN INSTRUCTIONAL AID 

Many of the problems presented in this book can be solved using the software 
on the companion website. However, it would not be wise to solve all prob¬ 
lems with this software since true understanding can only be gained solving the 
problem yourself. Still, some problems are so repetitive or long, it is extremely 
difficult to solve correctly without the aid of software. In these cases, the reader 
is often referred to the software on the companion website. For example, in 
Appendixes A through C, the matrix operations of addition, subtraction, mul¬ 
tiplication, and inversing are presented. Although the student is expected to 
solve the accompanying problems in these appendixes by hand, the MATRIX 
program should be used to solve the remainder of the problems presented in 
this book. This frees the reader of the matrix operations so that emphasis in 
learning can be placed on the topics presented in the chapters. However, the 
software can be used to check solutions. For example, many of the least squares 
adjustment routines in ADJUST have the option to create a file of matrices. 
When selected, this option creates the matrices used in the solution and pro¬ 
vides the user a method of checking matrices they have created in a spreadsheet. 
The Mathcad worksheets are also available to check the intermediate steps in 
a solution. 


APPENDIX H 


ANSWERS TO SELECTED PROBLEMS 


Note: Only partial answers are given to many of the problems to provide the 
reader with a check of their work. 

Chapter 1 

1.6(c) Systematic 

1.10(c) Systematic 
1.12(a) Instrumental 
1.13 0.003 m 


Chapter 2 

2.2(d) 186.498 

2.4(a) 8.3 

2.6(c) 0.2084 


Chapter 3 

3.1 1.28155 

3.7 0.28; 1.027, 3.885 

3.13(a) ±0.022 

3.14 (25.6986,28.3514) 
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Chapter 4 

4.2(a) a/2 = 0.05 x\ 95 3 = 0-35 x\ 05 3 = 7.82 

4.3(a) a/2 = 0.05 ? 0 . 05 ,3 = 2.35 

4.4(a) -F’o. 90 , 20,5 = 1/2.16 = 0.46 ^ 0 . 10 , 20,5 = 3.21 

4.5(a) ^2 = 50.23) = 6.15 

4.8(a) 102.159 <n< 102.164 

4.14 1.988 < a 2 < 20.049 

4.18(a) 3.14 < 4 < 10.57 

CT 2 

Chapter 5 

5.8(a) Two-tailed test 

5.11(a) Fail to reject H 0 . 

5.13(a) Fail to reject H 0 . 

Chapter 6 

6.1 ±9.7 mm 

6.5 2484.011 ± 0.015 m 

6.9 V = 38,300 ± 100 ft 3 

6.13 70,200 ± 100 ft 3 

Chapter 7 

7.4 ±0.012 ft 

7.9 ±12.0" 

7.13 Yes, estimated misclosure ±45.1" 


Chapter 8 

8.1(a) Direct 

8.3 Latitude = 96.64 ± 0.012 ft 

8.8 a = ±5.8"; <r 95 o /o = ±73.9" 

8.12(b) ±0.015 ft 

8.14(b) ±0.021 ft 

8.20(d) ±0.041 ft 

Chapter 9 

9.1 -5.98 ft 

9.3 -283.93 ft 

9.5 0.36 ft 

9.8 ±0.4 mm 

9.13 29.34 ft 
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Chapter 10 

10.1 56°14'47.5"±0.4" 

10.2 ±1.7" 

10.6 ±0.025 

10.9(a) 15.086 m 


Chapter 11 

11.1 A — 2.17, B = 0.64 

11.6 v 1= 0.043 

11.7 a- = 2.00; y 0.51 

11.12 1 = 114°23'00.2" 


Chapter 12 

12.1 X = 105.69 

12.2 S 0 = ±0.009 

12.8 15 + 00 = 758.12, S 0 = ±0.016 

Chapter 13 

13.1(a) ±0.91 

13.2(a) Fail to reject H n so you can use S 2 = 1 to compute statistics. 

13.3 S x = ±0.006 

13.9 Sj = ±0.006 

Chapter 14 

14.1 a = 4231.59 

14.2(b) ±0.971 

14.3(a) x c — 11,448.89 ± 0.014, y c — 10,388.25 ± 0.030 

14.7(a) x E = 7665.344 ± 0.009 


Chapter 15 

15.1 X= 9920.87, Y= 11,295.26 

15.4 X= 5105.93 ±0.152 

15.5(b) S 0 = ±1.8 
15.8(a) X B = 176.74 ±0.057 


Chapter 16 

16.1(b) X= 3127.22 ±0.014 
16.2(a) ±1.33 

16.4(b) X= 7816.522 ± 0.0091 
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Chapter 17 

17.1(a) X = 933,597.220 m, Y= -4,847,253.121 m, Z = 4,025,830.514 m 
17.2(a) 4> = 48°06'12.04369" N, A = 122°08'08.28458" W, h = 13.407 m 

17.3(a) B : (358046.504, -4628822.827, 4359249.118) 

17.3(c) Sq = ±1.08 

17.4(a) AX =0.51 ppm 

17.5(a) B: (-1732183.349, -4618647.415,4033514.424) 

17.13(a) AX = 5.94 ppm 


Chapter 18 

18.1(a) a = 0.92012 ± 0.0000081; b = -0.39175 ± 0.0000083 
18.1(c) 9 = 336°56'15.1"; Scale = 1.00005 

18.5(a) ci\ = 0.21110 ± 0.00012; b\ — —0.17658 ± 0.00006 
18.7(a) a = 0.06030 ± 0.15101; T x = 3.914 ± 42.908 
18.8 Projective transformation 


Chapter 19 

19.1 t = 69.08256°; S„ = ±0.41 

19.2 S u = ±2.52 

19.6 S u = ± 1.22 

19.22 S u = ±0.054 

19.27(a) 37% 


Chapter 20 

20.1 x B = 30,433.560; y B = 39,803.631 
20.7 EIev D = 129.020 m 

20.10(a) AB = 100.010; BC = 100.000 
20.13 S x = S y = ±0.0176 


Chapter 21 

21.1 See Section 21.2. 

21.10 No observations are detected as having a blunder. 
21.16 ±0.17 ft 


Chapter 22 

22.1 b = 1199.996 ft and m = 1.70320548 
22.4(a) a - 0.9201215; b = -0.3917527 
22.4(c) Scale = 1.0004692; 9 = 336°56'15" 
22.6(a) a — 0.9201326; b = 0.391752 
22.8 Affine transformation 
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Chapter 23 

23.1 458.794 m 

23.3 13°56'27.2" 

23.5 203°58'06.1" 

23.7 -2°36'09.6" 

23.9 0.49570^ - 0.86768^ + 0.03754^ - 0.49573rfe c + 0M161dn c - 

0.03750r/w c = -0.00825 ’ 

23.11 108.43156^ - 436.78988^ + 0.00003du B + 609.99716^ + 
847.21603^ 

0.00000^ - 718.40986<7« c - 410.40641<fe c + 0.00005rfw c = -7.97" 
23.30 3.7" 


Chapter 24 

24.2 Read Section 24.1, paragraph 2. 

24.5 Read Section 24.1, paragraph 5. 

24.6 XYZ = (1160652.638, -4655694.644, 4188424.104) 

24.18 (7612.03,7608.49,242.38) 


Chapter 25 

25.3 No 
25.12 6.87 mm 

25.14 Yes 
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X 1 distribution, 59-61, 85-86, 
637-638 

X 2 test, 85-89, 330, 568 
Accuracy 

1998 FGDC standards, 435-440 
definition of, 5 
examples of, 5-6 
local, 438 

network, 436, 438, 440 
Adjoint, 610 
ADJUST 

blunder detection, 489 
coordinate transformation files, 
393 

differential leveling files, 236 
estimating errors in traverses, 156 
GNSS baseline files, 366-367 
horizontal network files, 318, 324 
overview, 33 

three-dimensional geodetic 
networks, 537-538 
triangulation hies, 297 
trilateration hies, 275 


Adjustment 

constrained, 63, 71, 89-90, 443, 

468 

minimally constrained, 71-72, 
89-90, 362-363, 468, 476 
Adjustment of control coordinates, 
443-449 

Affine coordinate transformation, 395 
general least squares method, 507 
Alternative hypothesis, 79, 330 
Angle 

error in astronomical observation, 
130 

error in directional method, 115 
error in instrument centering, 120 
error in leveling, 123-124 
error in observation, 126 
error in pointing, 116 
error in reading, 114 
error in repetition method, 114 
error in target centering, 118 
error using range poles, 136 
error using total station, 117 
intersection adjustment, 288-293 
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Angle ( continued ) 

ISO 17123-3 standard, 117 
observation equation, 123, 286, 
518, 522, 528 
reading errors, 114-116 
resection adjustment, 294-298 
weight in, 185 
Apogee, 347 

ASPRS Accuracy Standards 

for Digital Geospatial Data, 439 
Astronomical observation, 130 
Azimuth, 130, 146, 535, 666-667 
Azimuth observation equation, 284, 
521, 529 

Baarda, Willem, 472 
Back solution, 583 
Baseline 

adjustment of, 362-363, 552 
analysis of, 356 
analysis of repeat, 357-358 
loop closure errors, 360 
Bessel’s correction, 31-32 
Bimodal distribution, 17-18 
Bivariate distribution, 122, 419-420 
Blunder 

a priori methods, 466 
definition of, 4 
detection of, 49, 58, 465-466 
example of, 477, 566 
graphical methods, 467, 572 
signs of residuals, 468, 565, 572 

Carrier phase-shift observations, 

344 

Chi-squared distribution, 59-61, 
85-86, 637-638 

Chi-squared test, 85-89, 330, 568 
Cholesky decomposition, 581 
Class 

frequency, 16 
interval, 16 
relative frequency, 16 
width, 15-16 


Class width 
definition of, 15 
example of, 15-16, 27 
Cofactor, 179 
Cofactor matrix 

of adjusted observations, 249 
of adjusted unknowns, 248-249 
definition of, 180 
examples, 249-250 
of residuals, 470 
Collimation error, 163 
Compound event, 40-41 
Conditional equation, 215-217 
Confidence interval 
definition of, 59 
mean, 63-66, 649 
population variance, 68-70 
ratio of two population variances, 
70-72 

sample, 66-68 
using STATS, 72-74 
Conformal coordinate 
transformation 

general least squares method, 392, 
503, 509 

three-dimensional, 401-407, 509, 
546-547 

two-dimensional, 389-390, 392, 
503-504 

Constrained adjustment 
definition of, 443 

elimination of constraints method, 
449 

Helmert’s method, 452-453 
least squares, 71, 89-90, 468 
minimally, 71-72, 89-90, 
362-363,468 

by over-weighting, 458-460 
redundancies, 458 
Constraint equation 

control station coordinate 
adjustment, 443 
elimination of, 262, 449 
Helmert’s method, 452-453 
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Constraints, geometric, 136, 193 
Control coordinates 
adjustment of, 443 
estimating uncertainties in, 447 
Control, minimum amount of, 
321-322,476 

Conventional Terrestrial Pole (CTP), 
348 

Coordinate system 
earth-centered, earth-fixed, 546 
geocentric, 348 
geodetic, 349, 518 
local geodetic, 517 
satellite, 348 

Coordinate transformation 
affine using general least squares 
method, 507 

conformal using general least 

squares method, 392, 503, 509 
eight parameter, 398-399, 508 
four parameter similarity, 389-390 
projective using general least 
squares method, 399, 507 
seven-parameter similarity, 
401-407, 509, 546-547 
six parameter, 395, 507 
three-dimensional conformal, 
401-407, 509, 546-547 
three-dimensional using general 
least squares method, 509, 

546 

two-dimensional affine, 395, 507 
two-dimensional conformal, 
389-390, 392, 503-504 
two-dimensional projective, 
398-399,508 
Covariance, 99, 179-180 
Covariance matrix 
of adjusted observations, 250-253 
of adjusted unknowns, 249-250 
definition of, 97-101, 248-249 
development of, 97-101, 248-249 
example of, 249 
in traverse course, 145 


Data 

classes in, 15-16 
graphical representation of, 

15-18 

population, 13-14 
range of, 14-15, 24, 27 
sample, 13-14 
Data snooping, 472 
Datum, 545 

Deflection of vertical, 535 
Degrees of freedom, 20 
Density function, 42 
Detectable blunder, 485 
Determinant, 607 
Differencing 
double, 345 
single, 345 
triple, 345 

Differential leveling 
adjustment of, 226-231 
collimation error in, 163-164 
leveling errors in, 163-166 
observation equation, 225 
random errors in, 166-171 
reading error in, 166-171 
rod plumbing error in, 167-169 
systematic errors in, 163-166, 
536-537 

in three-dimensional adjustment, 
522 

weights in, 186-187, 229 
Discrepancy, 4 
Dispersion, 14 

Distance observation equation 
definition of, 259 
linearized, 261 
Distribution 

F, 62-63,641-648 
normal, 17, 42, 193, 565-566, 629, 
635-636 
sampling, 59 
t, 61-62, 84, 639-640 
X 2 , 59-61,85-86, 637-638 
Double differencing, 345 
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Earth curvature and refraction error, 
165, 522, 535 

EDM calibration, 214-215 
Eight parameter transformation. 

See Projective coordinate 
transformation 

Elimination of constraints, 449 
Ellipse 

analysis of, 431 
computation of, 425 
Equation 

normal, 200, 201-204, 580-581 
observation, 199-200 (See also 
Observation equation) 
residual, 199-200, 231 
Error 

in angular misclosure of traverse, 
127-130, 146-148, 152-153 
in azimuth observations, 130, 146, 
535 

in azimuths of traverses, 146 
collimation, 163 
definition of, 3, 19-20 
earth curvature and refraction, 
165, 522, 535 
in electronic distance 

measurement, 135-136 
ellipse, 419 
GNSS, 347 
gross, 3 

instrumental, 3, 120 
in leveling, 163-166 
in linear misclosure of traverse, 
146, 148-151, 153-154 
natural, 3 
personal, 3 
radial, 435 

random, 4,21, 113-114, 135-136, 
166-171, 565 

sources in angles, 113-114 
sources in electronic distance 
measurement, 135 
standard, 21-22 


systematic, 4, 5-7, 115, 163-166, 
534-537 

in traverse course, 144-145, 156 
in trigonometric leveling, 171-174 
in zenith angles, 172 
Error ellipse 
advantages of, 409 
confidence level of, 429-431 
in network design, 431-435, 487 
overview, 419-421 
Error propagation 
in angles, 126-127 
definition of, 2 
in distances, 135 
equation, 97-101, 245 
in leveling, 163-174 
in traverse surveys, 143 
Estimator, 59 
EXCEL® 

accompanying hies, 219 
errors in traverse computations, 
156 

estimating error in observations, 
137 

spreadsheet use, 33, 674 
External reliability, 486 

F distribution, 62-63, 641-648 
FGDC standards, 435-440 
Fisher distribution, 62-63, 641-648 
Fit of points to a line, 211-213 
Fit of points to a parabola, 213-214 
Forward solution, 583 
Four-parameter similarity 

transformation. See Conformal 
coordinate transformation 
Free network adjustment, 322 
Frequency histogram, 15-18, 26, 52 
Functional model, 197-198 

General law of propagation of 

variances (GLOPOV), 100, 143, 
250-251 
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General least squares method 
affine coordinate transformation, 
507 

conformal coordinate 

transformation, 392, 503, 

509 

projective coordinate 

transformation, 399, 507 
solution, 499-500 
for straight line, 497-499 
three-dimensional coordinate 
transformation, 509, 546 
Geocentric coordinate system, 348 
Geodetic height, 349, 523, 557 
Geodetic network, three-dimensional 
adjustment of, 517, 537-538 
Geoid separation, 523 
Geometric constraints, 146, 193 
Global navigation satellite system 
(GNSS) 

baselines, 346, 363, 366-367 
observations, 344-347 
overview, 257 

preanalysis of observations, 

356 

GLOPOV, 100, 143, 250-251 
GNSS. See Global navigation 
satellite system (GNSS) 
Goodness of fit test, 330, 568 
GPS, 257, 343-344 

Height 

geodetic, 349, 523, 557 
geoid, 349, 557 
orthometric, 349, 522, 557 
Helmert transformation, 547-548 
Helmert’s method, 452-453 
Histogram 

bimodal, 17-18 
definition of, 15-16 
example of, 16-17, 26 
skewed, 18, 52 
using STATS, 32-33 


Hour angle 

Greenwich, 130, 348 
local, 130 

Hypothesis testing 

alternative hypothesis, 79, 330 

false negative, 82 

false positive, 82 

level of significance of, 81 

null hypothesis, 79, 330 

for the population mean, 84-85 

power of test, 81 

ratio of two variances, 89-92 

rejection criterion, 80-81 

test decision, 80 

test statistic, 79-80 

type I error, 80 

type II error, 80 

using STATS, 92-93 

for variance, 85-89 

Indirect measurement, 2 

Internal reliability, 485 

Iteration, termination of, 273 

Jacobian matrix, 100, 148, 208, 263, 
294,622 

Keplarian parameters 
argument of perigee, 348 
eccentricity, 348 
Greenwich hour angle of the 
vernal point, 348 
inclination angle, 348 
right ascension of the ascending 
node, 348 

semimajor axis, 348 

Lambert Conformal Conic 
as map projection system, 656 
mathematics of, 657-659 
reduction of distances, 664 
reduction of geodetic 
azimuths, 666 
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Lambert Conformal Conic 
(i continued ) 

reduction of observations, 663 
stereographic, 662 
Transverse Mercator, 656, 659 
Law of cosines, 123 
Least squares 

adjustment of angles, 283 
adjustment of distances, 257 
adjustment of horizontal 
networks, 313 

adjustment of intersections, 288 
adjustment of resections, 293 
advantages of, 8-10 
affine coordinate transformation, 
507 

analysis of, 432, 465, 566 
angle intersection, 432, 465, 
566-567 

conditional adjustment, 198, 
215-216 

conditional adjustment model of, 
198 

conformal coordinate 

transformation, 392, 503, 509 
constrained, 71, 89-90, 468 
differential leveling adjustment, 225 
fit of points to a line, 211 -212, 500 
fit of points to a parabola, 

213-214 

fundamental principle, 194-197 
generalized method, 497-503 
minimally constrained, 71, 89-90, 
468 

parametric adjustment model of, 
198 

projective coordinate 

transformation, 399, 507 
simulated adjustment, 488 
stochastic model in, 197 
three-dimensional coordinate 
transformation, 509, 546 
three-dimensional geodetic 
network, 517 


Line of apsides, 347 
Link traverse misclosure error, 
152-156 

Local accuracy, 438 
Localization, 390, 551 

Map projection coordinate systems 
coordinate transformation and, 
556-559 

horizontal surveys and, 257-258 
Lambert Conformal Conic, 656, 
657-659 

oblique stereographic, 556, 662 
overview, 655-656 
reduction of distances, 664-666 
reduction of geodetic azimuths, 
666-667 

reduction of observations, 663-667 
stereographic, 662-663 
Transverse Mercator, 656, 659-662 
Mapping standards, 28-31 
MATHCAD® 

files in, 219, 276, 288, 324, 367, 

394, 490, 537 

map projections in, 659, 663 
statistical functions in, 33, 490 
Matrix 

addition, 595 

Cholesky decomposition of, 581 
cofactor, 180, 248-249, 251 
column, 593 

covariance, 99, 145, 179, 248, 
251-252 
definition of, 591 
determinant of, 607 
diagonal, 594 
dimensions of, 592 
elementary row transformations, 
611 

equality, 594 
equivalent weight, 499 
inverse of, 607 

Jacobian, 100, 148, 208, 263, 294, 
622 
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multiplication, 595 
partitioning of, 253 
row, 593 

scalar multiplication of, 595 
size of, 592 

solution of equations, 607 
square, 593 
symmetric, 594 
transpose of, 594 
types of, 593 
unit, 594 
vector, 593 

weight, 180, 207, 365-366, 499 
Matrix algebra, 591 
Matrix operations, computer 

algorithms of, 577-589, 598, 
615 

MATRIX software 
differential leveling, 236 
horizontal network, 318 
triangulation, 297 
trilateration, 269, 274 
using, 33 
Mean 

arithmetic, 5, 19 
confidence interval, 63-66, 649 
example of, 19, 24, 26 
population, 19, 84-85 
sample, 19 

standard deviation of, 22, 102, 

182 

weighted, 181-183 
Measure of central tendency 
definition of, 18-19 
mean, 19 
median, 19 
mode, 19 

Measurements, direct and indirect, 2 
Median 

definition of, 15, 19 
example of, 24 

Minimally constrained adjustment, 
71-72, 89-90, 362-363,468, 
476 


Misclosure in traverse, 146-151, 
152-156 
Mistakes, 3-4 
Mode 

definition of, 19 
example of, 24, 27 
Model 

functional, 197-198 
mathematical, 198-199 
stochastic, 197 
Most probable value, 20 

NAYSTAR GPS, 343 
Network 

adjustment of, 322 
definition of, 322 
design of, 431-435, 487 
GNSS baseline, 346, 363, 

366-367 
leveling, 226 

Noncentrality parameter, 485 
Nonlinear equations 
angle, 286 
azimuth, 284 
distance, 260 
linearized, 261, 287, 314 
solution of, 619 
Normal 

distribution, 17, 193, 565-566, 
629, 635-636 
distribution curve, 42, 629 
distribution function, 44, 629, 
635-636 
radius of, 351 
Normal equation 
definition of, 200 
direct formation, 580-581 
systematic formulation of, 
201-203 

tabulation formation, 203-204 
Normal matrix 
definition of, 205 

direct formation of, 204-207, 268, 
580-581 
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Null hypothesis 
definition of, 79 
failure to reject, 80-81, 330 

Observation 

analysis of, 13-19, 432, 465-466, 
565 

measurements and, 2, 18 
nonspur, 474-475 
population, 13-14 
propagation, 2 
redundant, 7-8, 20, 232, 458 
sample, 13-14 
spur, 474-475 
Observation equation 

altitude angle, 123, 518, 522 
angles, 123, 286, 518, 522, 528 
azimuth, 284, 521, 529 
baseline vector, 363, 552 
control station coordinates, 443, 
530 

definition of, 199 
differential leveling, 225, 522 
distance, 259, 519, 523, 525, 527 
horizontal angle, 286, 522, 528 
horizontal distance, 260, 523-524 
horizontal network, 314, 322 
overview, 199-200 
projective coordinate 

transformation, 398-399, 
507-508 

slant distance, 519, 527 
three-dimensional conformal 
coordinate transformation, 
404, 509 

two-dimensional affine coordinate 
transformation, 395, 507 
two-dimensional conformal 
coordinate transformation, 
392, 504 

two-dimensional coordinate 
transformation, 389-390, 
392, 503 


two-dimensional projective 

coordinate transformation, 
398-399,508 
vertical plane, 522 
Orthometric height, 349, 522, 557 

PDOP (Positional dilution of 
precision), 433, 488 
Perigee, 347-348 
Pope, Alan J., 474 
Population, 13-14 
Population variance, 20, 85-86, 

330 

Positional dilution of precision 
(PDOP), 433, 488 
Precision, 4-6 
Probability 

computation of, 44-49 
curve, 42, 629 
standard error, 21-22, 47 
theory of, 39 

Probability curve, 42, 629 
Probability density function, 42, 

629 

Probable error 
50%, 48 
95%, 49 
other values, 49 
uses of, 50-52 
Projective coordinate 

transformation, 398-399, 
507-508 

general least squares method, 399, 
507 

Propagation of variance 
general law, 100 
special law, 101 
Prototype equation 
angles, 522 

azimuths, 286, 314, 521 
baseline vector, 363 
for differential leveling, 225 
for distances, 261, 314, 523-524 
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horizontal angles, 258, 314, 522 
horizontal network, 314 
slant distances, 519 
Pseudorandom noise codes, 344 
Pseudoranging, 344 

Radial error, 435 
Random error 
in angles, 113-114 
definition of, 4 
in electronic distance 

measurements, 135-136 
in leveling, 166-171 
properties of, 4, 21, 565 
Range 

definition of, 14 
example of, 14-15, 24, 27 
in GNSS, 344 
Redundancy number 
definition of, 472 
effects in blunder detection, 485 
relative, 472 

Redundant observations, 7-8, 20, 
232,314 

Reference frames, 545-546 
Reference variance, 180, 231-232, 
248,318-319, 330, 568-569 
Rejection criterion, 80, 472-473 
Relative positioning, 346 
Relative redundancy, 472 
Reliability 
external, 486 
internal, 485 

Reordering algorithms, 587 
Resection, adjustment of, 293 
Residuals 

analysis of, 465-466, 565-568 
cofactor matrix of, 470 
computation of, 24-25 
definition of, 20 
equation, 199-200, 231 
equivalent, 499 
properties of, 565 


signs of, 468, 565, 572 
standardized, 472 
use of plots, 572 

Root mean square error (RMSE), 
27-31,439 

Sample 

definition of, 13-14 
selecting size of, 67-68 
Sample variance, 21 
Sampling distribution, 59 
Satellite system 

GNSS, 257, 328, 344-347, 356, 
363, 366-367 
GPS, 257, 343-344 
TRANSIT, 343 
Seven-parameter similarity 
transformation. See 
Three-dimensional conformal 
coordinate transformation 
Single differencing, 345 
Site calibration. See Localization 
Six parameters transformation. 

See Affine coordinate 
transformation 
Slant distance, 519 
Sparseness in matrix, 586 
Special law of propagation of 

variance (SLOPOV), 101, 143 
Spreadsheets, use of, 33, 674 
Standard deviation 
definition of, 22 
example of, 24-25 
of the mean, 22, 102 
modified for weighted 
observations, 184 
reference, 231-232, 249 
in series, 102 
in sum, 102 

of unit weight, 181, 231-232, 249 
of weighted mean, 182 
Standard error 
definition of, 22, 31 
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Standard error ( continued ) 
probability of, 47 
relation to weight, 183 
of weight w, 184-185 
Standard error ellipse, 421 
Standard error rectangle, 419 
Standardized residual, 472 
Statistic, definition of, 18 
Statistical test 
F, 89 

goodness-of-ht, 330 
one-tailed, 83 
for population mean, 84 
for population variance, 85-86, 
330 

for ratio of two variances, 89 
t, 84 

two-tailed, 83 
/ 2 , 85-89, 330, 568 
STATS 

confidence intervals, 72-74 
histogram data, 32-33 
hypothesis testing, 92-93 
Stochastic model, 197 
Storage optimization, 586 
Survey planning and design, 157, 
431-432, 487 
Systematic error 
in azimuths, 535 
definition of, 4 
examples of, 4, 5-7 
in leveling, 163-166, 536-537 
in vertical angles, 535 

t distribution, 61-62, 84, 639-640 
Table 

confidence intervals, 650-654 
F distribution, 642-648 
standard normal distribution, 
635-636 

t distribution, 640 
/ 2 , 638 

Tabular method, 203 


Tau criterion, 474 
Taylor’s theorem 

nonlinear equations and, 

619-620 

use of, 207-208, 260, 285, 287 
Test decision, 80 
Test statistics, 79-80 
Three-dimensional conformal 
coordinate transformation, 
401-407, 509, 546-547 
general least squares method, 509, 
546 

Three-dimensional geodetic network 
adjustment, 517, 537-538 
Transformation between reference 
frames, 545-546 
TRANSIT, 343 
Traverse 

error in angular misclosure, 

127-130, 146-148, 152-153 
error in latitude and departure, 
144-145 

error in linear misclosure, 146, 
148-151,153-154 
estimating errors using EXCEL®, 
156 

misclosure in, 127-130, 146-156 
Triangulation adjustment, 283 
Trigonometric leveling, error in, 
171-174 

Trilateration adjustment, 257 
Triple differencing, 345 
True value, definition of, 19 
Two-dimensional 

affine coordinate transformation, 
395,507 

conformal coordinate 

transformation, 389-390, 

392, 503-504 
projective coordinate 

transformation, 398-399, 508 
Type I error, 80 
Type II error, 80 
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Valid parameters, 407-411 
Variance 

alternative formula for, 22-24 
definition of, 20 
example of, 27 
population, 20, 85-86, 330 
reference, 180, 330 
sample, 21 

of unit weight, 181, 231-232, 249, 
330 

Vertical, deflection of, 535 


Weight 

in angles, 185 
definition of, 179 
in differential leveling, 186-187 
relation to correction, 183 
relation to standard error, 183 
relation to variance, 179, 183 
Weight matrix, equivalent, 180, 
499 

Weighted mean, 181-183 


